{"id":10,"date":"2022-01-10T13:03:13","date_gmt":"2022-01-10T13:03:13","guid":{"rendered":"http:\/\/vargas-solar.com\/cloud-bigdata\/?page_id=10"},"modified":"2022-05-06T12:30:05","modified_gmt":"2022-05-06T12:30:05","slug":"content-lab","status":"publish","type":"page","link":"http:\/\/vargas-solar.com\/cloud-bigdata\/content-lab\/","title":{"rendered":"HANDS-ON: LAB"},"content":{"rendered":"\n<p>Complete syllabus here: <a rel=\"noreferrer noopener\" href=\"https:\/\/drive.google.com\/file\/d\/1Euq4GHGecmXka_I5nfqlU5tehIT_dYH0\/view?usp=sharing\" target=\"_blank\">LIS-4112<\/a><\/p>\n\n\n\n<ul class=\"wp-block-list\" type=\"1\"><li><strong>Definition and reference architecture  [<a rel=\"noreferrer noopener\" href=\"https:\/\/drive.google.com\/file\/d\/1x7kS04RI5lF30CI0P62820Jac0IZcq4D\/view?usp=sharing\" target=\"_blank\">slides<\/a>] [<a rel=\"noreferrer noopener\" href=\"https:\/\/youtu.be\/krEg5yW_MIA\" target=\"_blank\">Yo<\/a><\/strong><a rel=\"noreferrer noopener\" href=\"https:\/\/youtu.be\/krEg5yW_MIA\" target=\"_blank\">uTube<\/a>]<ul><li>Principle and reference architecture [<a rel=\"noreferrer noopener\" href=\"https:\/\/drive.google.com\/file\/d\/1XhlrRNLB-BPIUEuYi0qmj_QoJ9wrOAvI\/view?usp=sharing\" target=\"_blank\">slides<\/a>]<\/li><li>Service as unit of construction [<a rel=\"noreferrer noopener\" href=\"http:\/\/vargas-solar.com\/cloud-bigdata\/ho-1-services-as-a-unit-of-construction\/\" data-type=\"page\" data-id=\"94\" target=\"_blank\">URL]<\/a> [<a rel=\"noreferrer noopener\" href=\"https:\/\/drive.google.com\/file\/d\/1pXVK7rF_u8esFpVBruyfeaEL4jdM7G2i\/view?usp=sharing\" target=\"_blank\">HO-1]<\/a>[<a rel=\"noreferrer noopener\" href=\"https:\/\/youtu.be\/KJqZlAbM2yc\" target=\"_blank\">YouTube<\/a>][<a rel=\"noreferrer noopener\" href=\"https:\/\/youtu.be\/IZ1VDauHvs0\" target=\"_blank\">YouTube<\/a>][<a rel=\"noreferrer noopener\" href=\"https:\/\/youtu.be\/aYFEbU5813U\" target=\"_blank\">YouTube<\/a>]<\/li><li>Pay as you go models<\/li><\/ul><\/li><li><strong>Use of storage and distributed computing resources<\/strong><ul><li>Data Labs and first experience with (big) data processing pipelines <ul><li>[<a rel=\"noreferrer noopener\" href=\"http:\/\/vargas-solar.com\/cloud-bigdata\/data-lab-environment\/\" data-type=\"page\" data-id=\"148\" target=\"_blank\">Environment<\/a>][<a rel=\"noreferrer noopener\" href=\"https:\/\/youtu.be\/5GRzLNODez0\" target=\"_blank\">YouTube<\/a>]<\/li><li>Getting started with the data science ecosystem [<a rel=\"noreferrer noopener\" href=\"http:\/\/vargas-solar.com\/data-centric-smart-everything\/getting-started-with-the-data-science-ecosystem\/\" target=\"_blank\">HO-1<\/a>]<\/li><li>Exploring data collections using descriptive statistics [<a rel=\"noreferrer noopener\" href=\"http:\/\/vargas-solar.com\/data-centric-smart-everything\/hands-on\/exploring-data-collections-using-descriptive-statistics\/\" target=\"_blank\">HO-2<\/a>]<\/li><li>Analysing graphs [<a rel=\"noreferrer noopener\" href=\"http:\/\/vargas-solar.com\/data-centric-smart-everything\/network-analysis\/\" target=\"_blank\">HO-3<\/a>]<\/li><\/ul><\/li><\/ul><ul><li>Data distribution: distributed file systems (e.g., HDFS), NoSQL\/NewSQL<\/li><li>Parallel programming models (MapReduce) and execution environments (e.g., Hadoop, Spark) [<a rel=\"noreferrer noopener\" href=\"https:\/\/youtu.be\/hTAo6QG7HA0\" target=\"_blank\">YouTube<\/a>]<ul><li>Hadoop: <a rel=\"noreferrer noopener\" href=\"http:\/\/vargas-solar.com\/cloud-bigdata\/executing-map-reduce-programs-on-hadoop-environments\/\" data-type=\"page\" data-id=\"179\" target=\"_blank\">Exercise-1<\/a><\/li><li>Spark:<a href=\"http:\/\/vargas-solar.com\/cloud-bigdata\/first-steps-into-data-flow-based-programming\/\" data-type=\"page\" data-id=\"194\"> <\/a><a rel=\"noreferrer noopener\" href=\"http:\/\/vargas-solar.com\/cloud-bigdata\/first-steps-into-data-flow-based-programming\/\" data-type=\"page\" data-id=\"194\" target=\"_blank\">Exercise-2<\/a><\/li><\/ul><\/li><\/ul><\/li><li><strong>Virtualization techniques<\/strong>: hypervisors vs. containers, distributed resource brokers<ul><li>DevOps Introduction: Virtual machines for running Spark programs on MS Azure [<a rel=\"noreferrer noopener\" href=\"https:\/\/drive.google.com\/file\/d\/1472mUWgq76gjEOcmr1zUgENzzpw-IKbi\/view?usp=sharing\" target=\"_blank\">slides<\/a>][<a rel=\"noreferrer noopener\" href=\"https:\/\/docs.google.com\/document\/d\/1Gd5hKzPSFEe3aC3rgmq_MjJzh8pP6J5V\/edit?usp=sharing&amp;ouid=101607215318656341432&amp;rtpof=true&amp;sd=true\" target=\"_blank\">Exercise<\/a>][<a rel=\"noreferrer noopener\" href=\"https:\/\/youtu.be\/QPn03JLs_Pg\" target=\"_blank\">YouTube<\/a>]<\/li><li>Componentization: playing with docker [<a rel=\"noreferrer noopener\" href=\"https:\/\/drive.google.com\/file\/d\/1asgN-U-uOo4IZI9ndEhMeNzYhGghae_x\/view?usp=sharing\" target=\"_blank\">slides<\/a>] [<a rel=\"noreferrer noopener\" href=\"http:\/\/vargas-solar.com\/cloud-bigdata\/quickstart-deploy-a-container-instance-in-azure-using-the-azure-cli\/\" target=\"_blank\">Exercise-1<\/a>][<a rel=\"noreferrer noopener\" href=\"https:\/\/drive.google.com\/drive\/folders\/1dv9wtrHUrIyyey5cb2MOt62d5Z31zqPU?usp=sharing\" target=\"_blank\">Exercise-2<\/a>][<a rel=\"noreferrer noopener\" href=\"https:\/\/youtu.be\/vYaAGsFw5ok\" target=\"_blank\">YouTube<\/a>][<a rel=\"noreferrer noopener\" href=\"https:\/\/youtu.be\/_SbbbudgVko\" target=\"_blank\">YouTube<\/a>]<\/li><\/ul><\/li><li><strong>Cloud virtual machines for data science (big data analytics) <\/strong>[<a href=\"https:\/\/drive.google.com\/file\/d\/1G34BR0qLoGkPzA3l3H6rtFRLTYByNRzS\/view?usp=sharing\" target=\"_blank\" rel=\"noreferrer noopener\">slides<\/a>][<a rel=\"noreferrer noopener\" href=\"https:\/\/youtu.be\/8eDvO66_WEM\" target=\"_blank\">YouTube<\/a>]<\/li><\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Complete syllabus here: LIS-4112 Definition and reference architecture [slides] [YouTube] Principle and reference architecture [slides] Service as unit of construction [URL] [HO-1][YouTube][YouTube][YouTube] Pay as you go models Use of storage and distributed computing resources Data Labs and first experience with (big) data processing pipelines [Environment][YouTube] Getting started with the data science ecosystem [HO-1] Exploring data [&hellip;]<\/p>\n","protected":false},"author":11,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"page-templates\/full-width.php","meta":{"footnotes":""},"class_list":["post-10","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"http:\/\/vargas-solar.com\/cloud-bigdata\/wp-json\/wp\/v2\/pages\/10","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/vargas-solar.com\/cloud-bigdata\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"http:\/\/vargas-solar.com\/cloud-bigdata\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"http:\/\/vargas-solar.com\/cloud-bigdata\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"http:\/\/vargas-solar.com\/cloud-bigdata\/wp-json\/wp\/v2\/comments?post=10"}],"version-history":[{"count":33,"href":"http:\/\/vargas-solar.com\/cloud-bigdata\/wp-json\/wp\/v2\/pages\/10\/revisions"}],"predecessor-version":[{"id":239,"href":"http:\/\/vargas-solar.com\/cloud-bigdata\/wp-json\/wp\/v2\/pages\/10\/revisions\/239"}],"wp:attachment":[{"href":"http:\/\/vargas-solar.com\/cloud-bigdata\/wp-json\/wp\/v2\/media?parent=10"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}