Latest Open Source Updates Include Impala, Spark, Pig and Hive

The November release of the Apache open source packages in MapR was made available for customers earlier this month. We are excited to deliver some major upgrades to existing packages.

Here are the highlights:

  • Impala has been upgraded to the 1.4.1 version - although 1.2.3 continues to be supported - so upgrade when you are ready. Several interesting updates for Impala include Apache Sentry based authorization for Impala on MapR, performance improvements for the MapR platform, and the core 1.4.1 improvements for Impala including new datatypes and SQL semantics.

  • Apache Spark upgrades to 1.1.0 bringing performance and operational improvements to Spark core and new extensions to MLLib and SparkSQL.

  • We have a major update for Apache Pig with Pig 0.13 - several bug fixes and improvements across the board including handling complex data types such as Parquet.

  • Hive 0.12 and 0.13, Sqoop 1.4.4 and 1.4.5 are some of the other updates that continue to work across the previous MapR 3.1.1 release and the current 4.0.1 releases with or without YARN.

Please refer to the individual release notes for more details:

http://package.mapr.com/releases/ecosystem/ and http://package.mapr.com/releases/ecosystem-4.x/

Pig

Version: 0.13

URL: https://github.com/mapr/pig

Tag: 0.13-mapr-1410

Release notes: http://doc.mapr.com/display/components/Pig+0.13.0-1410+Release+Notes

Spark

Version: 1.1.0

URL: https://github.com/mapr/spark

Tag: v1.1.0-mapr-3.x-1410

Tag: v1.1.0-mapr-4.x-1410

Release notes: http://doc.mapr.com/display/components/Spark+and+Spark+on+YARN+1.1.0-1410+Release+Notes

Sqoop

Version: 1.4.4

URL: https://github.com/mapr/sqoop

Tag: 1.4.4-mapr-1410

Release notes: http://doc.mapr.com/display/components/Sqoop+Release+Notes

Version: 1.4.5

URL: https://github.com/mapr/sqoop

Tag: 1.4.5-mapr-1410

Release notes: http://doc.mapr.com/display/components/Sqoop+Release+Notes

Impala

Version: 1.4.1

URL: https://github.com/mapr/impala

Tag: 1.4.1-mapr-1410

Release notes: http://doc.mapr.com/display/components/Impala+1.4.1+Release+Notes

Sentry

Version: 1.4.0

URL: https://github.com/mapr/incubator-sentry

Tag: 1.4.0-mapr-1410

Release notes: http://doc.mapr.com/display/components/Sentry+1.4.0-1410+Release+Notes

Hive

Version: 0.13

URL: https://github.com/mapr/hive

Tag: 0.13-mapr-1410

Tag: 0.13-mapr-1410-protobuf241

Tag: 0.13-mapr-1410-protobuf250

Release notes: http://doc.mapr.com/display/components/Hive+0.13.0-1410+Release+Notes

Version: 0.12

URL: https://github.com/mapr/hive

Tag: 0.12-mapr-1410

Release notes: http://doc.mapr.com/display/components/Hive+0.12.0-1410+Release+Notes

no

Streaming Data Architecture:

New Designs Using Apache Kafka and MapR Streams

 

 

 

Download for free