Apache Open Source Package Updates for September Include Apache Drill, Apache Spark 1.0.2 and More

The September release of the Apache open source packages in MapR is now available for customers. The September updates to the Apache Open Source packages in the MapR Distribution are part of the MapR 4.0.1 major release. Details about the MapR 4.0.1 release can be found here.

Here are the top highlights of this month’s release:

  • Apache Drill is now part of the MapR Distribution. For details of the Apache Drill release, as well as info on the incredible momentum Drill is gathering with users and partners, check out the official Drill press release.
  • The latest Hadoop Core package including YARN (2.4.1) is now available on MapR.
  • In the spirit of providing easy upgrades through backward compatibility of packages across versions, MapR now allows both MapReduce v1 and YARN jobs to coexist on the same nodes. Users can deploy YARN software and still run their applications unchanged until they are ready to migrate to using YARN-based resource management.
  • The 4.0.1 release also provides several unique benefits for YARN users on MapR, including:
    • Label-based scheduling (or job placement control) for YARN jobs, giving users the capability to run YARN jobs on specific nodes within the cluster. This feature comes especially handy in a multi-tenant production environment where departmental data may be stored on specific nodes within the cluster.
    • Disk I/O characteristics are now taken into account for YARN resource calculation. This goes beyond the memory and CPU characteristics supported by YARN, and allows for disk I/O bottlenecks to be correctly identified and managed within a production environment.
  • Spark 1.0.2 makes its way into the MapR Distribution with relevant updates to the entire Spark ecosystem, including Spark SQL, Spark Streaming, MLlib, and GraphX.
  • Apache Storm has been certified to work with the 4.0.1 release of MapR and users can deploy it with or without YARN.
  • Apache Tez project is now available for Developer Preview on the MapR Distribution, providing early access to developers who want to play with Tez. MapR does not formally support developer preview software, but the forums are available for any questions you may have.
  • MapR now supports HBase 0.98.4 along with HBase 0.94.21 on the same distribution.

Please refer to the individual links for details of the release.

Here is the link to the release notes: http://doc.mapr.com/display/RelNotes/Version+4.0.1+Release+Notes

Version: 2.4.1
URL: https://github.com/mapr/hadoop-common.git
Tag: release-2.4.1-mapr-1408
Packages available as part of the MapR 4.0.1 release at http://package.mapr.com/releases/v4.0.1

Version: 1.5.0

URL: https://github.com/mapr/asynchbase

Tag: v1.5.0-mapr-1408

Release notes: http://doc.mapr.com/display/components/AsyncHBase+1.5.0-1408+Release+Notes


Version: 0.98.4

URL: https://github.com/mapr/hbase

Tag:  0.98.4-mapr-1408

Release note: http://doc.mapr.com/display/components/HBase+0.98.4-1408+Release+Notes


Version: 0.12

URL: https://github.com/mapr/hive

Tag:  0.12-mapr-1408

Release notes: http://doc.mapr.com/display/components/Hive+0.12.0-1408+Release+Notes

Version: 0.13

URL: https://github.com/mapr/hive

Tag:  0.13-mapr-1408

Release notes: http://doc.mapr.com/display/components/Hive+0.13.0-1408+Release+Notes

Version: 0.12
URL: https://github.com/mapr/pig

Tag: 0.12-mapr-1408

Release notes: http://doc.mapr.com/display/components/Pig+0.12.0-1408+Release+Notes

Version: 1.4.4
URL:  https://github.com/mapr/sqoop

Tag: 1.4.4-mapr-1408

Release notes: http://doc.mapr.com/display/components/Sqoop+1.4.4-1408+Release+Notes

Spark on Yarn
Version: 1.0.2
URL: https://github.com/mapr/spark
Branch: v1.0.2-mapr-yarn
Tarball available at http://package.mapr.com/labs/spark

Release notes: http://doc.mapr.com/display/components/Spark+on+YARN+1.0.2-1408+Release+Notes

Tez (developer preview)
Version: 0.4.0
URL: https://github.com/mapr/tez
Tag: v0.4.0-mapr-1408
Packages available at http://packagemapr.com/labs/tez

Release notes: http://doc.mapr.com/display/components/Tez+Release+Notes


Streaming Data Architecture:

New Designs Using Apache Kafka and MapR Streams




Download for free