{"id":99,"date":"2015-02-11T15:02:26","date_gmt":"2015-02-11T15:02:26","guid":{"rendered":"http:\/\/vargas-solar.com\/bigdata-fest\/?page_id=99"},"modified":"2015-06-24T15:45:43","modified_gmt":"2015-06-24T15:45:43","slug":"mr-patterns-on-an-elephant","status":"publish","type":"page","link":"http:\/\/vargas-solar.com\/bigdata-fest\/challenges\/mr-patterns-on-an-elephant\/","title":{"rendered":"MR patterns on an elephant"},"content":{"rendered":"<p>This is a practical exercise conceived for the HADAS group of the LIG@Grenoble.<\/p>\n<p><span style=\"color: #0000ff;\"><em>Authors: Genoveva Vargas-Solar &amp; Placido A. Souza Neto<\/em><\/span><\/p>\n<h2>Menu<\/h2>\n<ul>\n<li>Map reduce patterns [<a href=\"http:\/\/vargas-solar.com\/bigdata-fest\/wp-content\/uploads\/sites\/33\/2015\/02\/map-reduce-patterns.pdf\">pdf<\/a>]<\/li>\n<li>The elephant environment [<a href=\"http:\/\/fr.hortonworks.com\/hdp\/\" target=\"_blank\">http:\/\/fr.hortonworks.com\/hdp\/<\/a>]<\/li>\n<\/ul>\n<h2>To install<\/h2>\n<ul>\n<li>Here are the instructions for installing your environment\u00a0<a href=\"http:\/\/vargas-solar.com\/bigdata-fest\/wp-content\/uploads\/sites\/33\/2014\/11\/PIG-HortonWorks.pdf\">HORTONWORKS<\/a>\u00a0(<strong>version 2.1 !<\/strong>)<\/li>\n<li>Attention <strong>DO NOT<\/strong>\u00a0consider the Pig part that will not concern this exercice<\/li>\n<li>Eclipse as compilation environment<\/li>\n<\/ul>\n<h2>To Do<\/h2>\n<p><span style=\"line-height: 1.714285714; font-size: 1rem;\">Warming up: counting words and variations (static analysis,for an exercise and code see the &#8220;<\/span><em style=\"line-height: 1.714285714; font-size: 1rem;\">hands on&#8221;<\/em><span style=\"line-height: 1.714285714; font-size: 1rem;\"> section in this site)<\/span><\/p>\n<h3><em>Creativity moment<\/em><\/h3>\n<ul>\n<li><em><strong>Summarization<\/strong><\/em>: processing temperatures [<strong><a href=\"http:\/\/vargas-solar.com\/bigdata-fest\/wp-content\/uploads\/sites\/33\/2015\/02\/Challenge-max.pdf\">Challenge-max<\/a><\/strong>] <strong>[<a href=\"http:\/\/vargas-solar.com\/bigdata-fest\/wp-content\/uploads\/sites\/33\/2015\/02\/inputs.zip\">data<\/a><\/strong>] [<strong><a href=\"http:\/\/vargas-solar.com\/bigdata-fest\/wp-content\/uploads\/sites\/33\/2015\/02\/src-weather_temperature.zip\">partial source code<\/a><\/strong>]\n<ul>\n<li>Solution here\u00a0[<a href=\"http:\/\/vargas-solar.com\/bigdata-fest\/wp-content\/uploads\/sites\/33\/2015\/02\/HadoopTP-WeatherExample.pdf\">guide<\/a>] [<a href=\"http:\/\/vargas-solar.com\/bigdata-fest\/wp-content\/uploads\/sites\/33\/2015\/02\/Hadoop-Weather-Example.zip\">Hadoop-Weather-Example<\/a>] [<a href=\"http:\/\/vargas-solar.com\/bigdata-fest\/wp-content\/uploads\/sites\/33\/2015\/02\/weather-temperature.jar_.zip\">weather-temperature.jar<\/a>]<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<p><em><strong>Filtering<\/strong><\/em>:<\/p>\n<ul>\n<li>top ten users by reputation\u00a0 [<strong><a href=\"http:\/\/vargas-solar.com\/bigdata-fest\/wp-content\/uploads\/sites\/33\/2015\/02\/Challenge-top-k.pdf\">Challenge-top-k<\/a><\/strong>] [<strong><a href=\"http:\/\/vargas-solar.com\/bigdata-fest\/wp-content\/uploads\/sites\/33\/2015\/02\/Users.xml_.zip\">data<\/a><\/strong>] [<strong><a href=\"http:\/\/vargas-solar.com\/bigdata-fest\/wp-content\/uploads\/sites\/33\/2015\/02\/src-topk.zip\">partial source code<\/a><\/strong>]\n<ul>\n<li>Solution here [<a href=\"http:\/\/vargas-solar.com\/bigdata-fest\/wp-content\/uploads\/sites\/33\/2015\/02\/HadoopTP-DesignPatternFilteringTop-KExample.pdf\">guide<\/a>] [<a href=\"http:\/\/vargas-solar.com\/bigdata-fest\/wp-content\/uploads\/sites\/33\/2015\/02\/DP_Filtering-TopK.zip\">DP_Filtering-TopK<\/a>]<\/li>\n<\/ul>\n<\/li>\n<\/ul>\n<ul>\n<li><em><strong>Turbo: playing with hot patterns (demo)<\/strong><\/em>\n<ul>\n<li><em><strong>Join: [<a href=\"http:\/\/vargas-solar.com\/bigdata-fest\/wp-content\/uploads\/sites\/33\/2015\/02\/CH-6a-UserCommentJoin.pdf\">challenge<\/a>] [<a href=\"http:\/\/vargas-solar.com\/bigdata-fest\/wp-content\/uploads\/sites\/33\/2015\/02\/03-Join-Reduce-Side.zip\">code<\/a>]<\/strong><\/em><\/li>\n<\/ul>\n<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>This is a practical exercise conceived for the HADAS group of the LIG@Grenoble. Authors: Genoveva Vargas-Solar &amp; Placido A. Souza Neto Menu Map reduce patterns [pdf] The elephant environment [http:\/\/fr.hortonworks.com\/hdp\/] To install Here are the instructions for installing your environment&nbsp;HORTONWORKS&nbsp;(version 2.1 !) Attention DO NOT&nbsp;consider the Pig part that will not concern this exercice Eclipse [&hellip;]<\/p>\n","protected":false},"author":11,"featured_media":0,"parent":12,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"page-templates\/full-width.php","meta":{"footnotes":""},"class_list":["post-99","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"http:\/\/vargas-solar.com\/bigdata-fest\/wp-json\/wp\/v2\/pages\/99","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/vargas-solar.com\/bigdata-fest\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"http:\/\/vargas-solar.com\/bigdata-fest\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"http:\/\/vargas-solar.com\/bigdata-fest\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"http:\/\/vargas-solar.com\/bigdata-fest\/wp-json\/wp\/v2\/comments?post=99"}],"version-history":[{"count":35,"href":"http:\/\/vargas-solar.com\/bigdata-fest\/wp-json\/wp\/v2\/pages\/99\/revisions"}],"predecessor-version":[{"id":167,"href":"http:\/\/vargas-solar.com\/bigdata-fest\/wp-json\/wp\/v2\/pages\/99\/revisions\/167"}],"up":[{"embeddable":true,"href":"http:\/\/vargas-solar.com\/bigdata-fest\/wp-json\/wp\/v2\/pages\/12"}],"wp:attachment":[{"href":"http:\/\/vargas-solar.com\/bigdata-fest\/wp-json\/wp\/v2\/media?parent=99"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}