原创,转载请注明出处
花了点时间将drill+apache hadoop2.2 编译出来了。
之前在drill邮件列表将编译过程整理了一下,现在也整理一份放在我的iteye上面。。
1. add a profile section to pom.xml:
<profile>
<id>apache</id>
<properties>
<alt-hadoop>apache</alt-hadoop>
</properties>
<dependencies>
<dependency>
<groupId>org.apache.hadoop</groupId>
<artifactId>hadoop-common</artifactId>
<version>2.2.0</version>
<exclusions>
<exclusion>
<artifactId>commons-logging</artifactId>
<groupId>commons-logging</groupId>
</exclusion>
</exclusions>
</dependency>
<dependency>
<groupId>jline</groupId>
<artifactId>jline</artifactId>
<version>2.10</version>
</dependency>
</dependencies>
</profile>
2: complie the src:
mvn clean install -DskipTests -Papache
3. after compile successfully,
$ cd distribution/
$ ls
pom.xml src target
$ cd target/
$ tar -xf apache-drill-1.0.0-m1-incubating-binary-release.tar.gz
$ ls apache-drill-1.0.0-m1-incubating/lib/protobuf-java-2.4.1.jar
apache-drill-1.0.0-m1-incubating/lib/protobuf-java-2.4.1.jar
You need to change the
protobuf-java-2.4.1.jar to
protobuf-java-2.5.0.jar.
Test:
4. add a dfs storage in conf/storage-engines.json
"parquet-dfs" :
{
"type":"parquet",
"dfsName" : "hdfs://hadoop2:8020/drill"
}
5.You also need to make some changes in the bin/drill-config.sh
if [ "${HADOOP_HOME}x" != "x" ]
then
HADOOP_CLASSPATH=""
for jar in `ls[color=red] $HADOOP_HOME/share/hadoop/*/*.jar`[/color]
do
echo $jar | grep -v -f $DRILL_HOME/bin/hadoop-excludes.txt >/dev/null
if [ "$?" -eq "0" ]
then
HADOOP_CLASSPATH=$jar:$HADOOP_CLASSPATH
fi
done
export HADOOP_CLASSPATH=$HADOOP_HOME/conf:$HADOOP_CLASSPATH
//若你配置了HA,或者Federation,你同样需要将你的hadoop的conf添加进来
//这里改成export HADOOP_CLASSPATH=$HADOOP_HOME/etc/hadoop/:$HADOOP_CLASSPATH
fi
6.$ ./bin/sqlline -u jdbc:drill:schema=parquet-dfs
Loaded singnal handler: SunSignalHandler
/home/drill/.sqlline/sqlline.properties (No such file or directory)
scan complete in 25ms
scan complete in 4053ms
Connecting to jdbc:drill:schema=parquet-dfs
Connected to: Drill (version 1.0)
Driver: Apache Drill JDBC Driver (version 1.0)
Autocommit status: true
Transaction isolation: TRANSACTION_REPEATABLE_READ
sqlline version ??? by Marc Prud'hommeaux
0: jdbc:drill:schema=parquet-dfs> select * from "/drill/region.parquet"
. . . . . . . . . . . . . . . . > ;
SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
SLF4J: Defaulting to no-operation (NOP) logger implementation
SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.
+------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| _MAP |
+------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| {"R_REGIONKEY":0,"R_NAME":"AFRICA","R_COMMENT":"lar deposits. blithely final packages cajole. regular waters are final requests. regular accounts are according |
| {"R_REGIONKEY":1,"R_NAME":"AMERICA","R_COMMENT":"hs use ironic, even requests. s"} |
| {"R_REGIONKEY":2,"R_NAME":"ASIA","R_COMMENT":"ges. thinly even pinto beans ca"} |
| {"R_REGIONKEY":3,"R_NAME":"EUROPE","R_COMMENT":"ly final courts cajole furiously final excuse"} |
| {"R_REGIONKEY":4,"R_NAME":"MIDDLE EAST","R_COMMENT":"uickly special accounts cajole carefully blithely close requests. carefully final asymptotes haggle furious |
+------------------------------------------------------------------------------------------------------------------------------------------------------------------+
5 rows selected (4.928 seconds)
0: jdbc:drill:schema=parquet-dfs>
分享到:
相关推荐
https://www.tutorialspoint.com/apache_drill/apache_drill_pdf_version.htm https://www.tutorialspoint.com/apache_drill/apache_drill_pdf_version.htm ...
Learning Apache Drill 2019 最新版
450+ AWS,Hadoop,云,Kafka,Docker,Elasticsearch,RabbitMQ,Redis,HBase,Solr,Cassandra,ZooKeeper,HDFS,Yarn,Hive,Presto,Drill,Impala,Consul,Spark,Jenkins,Travis CI,Git,MySQL ,Linux,...
使用Apache Drill技术
介绍Apache Kylin的背景,技术架构及演进,产品功能和性能等内容,以及开源现状和发展方向等,例如与Spark/Drill等的集成等。Apache Kylin是由eBay研发并贡献给开源社区的Hadoop上的分布式大规模联机分析(OLAP)...
Altium输出gerber&Drill详细方法和步骤
disk drill 破解版, windowns 版。用于磁盘文件恢复,不限量
文件恢复工具,U盘恢复,硬盘恢复,文件恢复,disk drill破解版,免费
Disk Drill由多种数据恢复算法支持,可以读取NTFS, FAT32, EXT, HFS+和其他的文件系统。恢复在你系统硬盘和外部设备、SD卡和U盘、其他的笔记本电脑和计算机上由于误删除而丢失的数据。 快速而且简单全面的数据恢复,...
基于1.18版本整理了Apache Drill SQL中的常用函数
drill插件 + mog插件 这是一个用于方便比较代码更新的库 包括js插件文件和插件详细文档两个目录 如果你要下载的话,还是直接去链接里面下载吧!这里下载的都是比较碎片的文件,平时更新的代码文件也非常多。 ...
很好的学习了解Drill up/down的资料。
在本文中,我将结合SQL、Hadoop、Drill、RESTwithJSON、NoSQL及HBase等技术,讨论并展示如何使用DrillRESTAPI来查询HBase和Hive。同时我也会分享一个使用DrillRESTAPI的简单jQuery客户端,利用J
两个文件恢复工具 disk drill 与Recuva
Learning Apache Drill
disk drill mac版来帮您!这款苹果数据恢复软件提供磁盘监控、Mac清理、恢复驱动器、数据保护、数据备份等实用功能,支持快速扫描和深度扫描,所有丢失的数据都可以帮你找回,是找回你心爱数据的得力帮手!
Apache Drill 1.16.0驱动包用maven shaded重新打包,包名统一加上了shaded.xxx,drill-jdbc-all-1.16.0 shaded,和系统其他jar不会冲突
Apache Drill是一个分布式MPP查询层,支持针对NoSQL和Hadoop数据存储系统SQL和替代查询语言。 它的部分灵感来自 。 开发者 请阅读以设置和运行Apache Drill。 有关完整的开发人员文档,请参见 更多信息 请参阅或以...
Mac版 数据恢复专业软件破解版(Disk Drill)版本:3.1.804 官方版本:https://www.cleverfiles.com/