We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 6dbcfef commit 6c1852dCopy full SHA for 6c1852d
README.md
@@ -2,6 +2,17 @@
2
3
* 前言:使用scala和java混编完成,其中也涉及到python脚本来自动生成日志,linux crontab调度工具来定时执行脚本生成实时日志。生成的数据主要是模拟某学习网站学习视频课程的访问量(其中模拟的日志中URL以"/class"开头的表示实战课程,然后通过流水线Flume+Kafka+SparkStreaming进行实时日志的收集,HBase来存储数据)*
4
5
+### 注意事项(使用的软件工具及环境配置)
6
+1. hadoop-2.6.0-cdh5.7.0
7
+2. hbase-1.2.0-cdh5.7.0
8
+3. zookeeper-3.4.5-cdh5.7.0
9
+4. spark-2.2.0-bin-2.6.0-cdh5.7.0
10
+5. apache-flume-1.6.0-cdh5.7.0-bin
11
+6. kafka_2.11-0.9.0.0
12
+7. apache-maven-3.3.9
13
+8. jdk1.8.0_181
14
+9. scala-2.11.8
15
+
16
## 需求分析
17
18
1. 统计该网站实战课程的访问量。
0 commit comments