{"id":590,"date":"2025-12-07T16:57:08","date_gmt":"2025-12-07T16:57:08","guid":{"rendered":"http:\/\/vargas-solar.com\/data-centric-smart-everything\/?page_id=590"},"modified":"2025-12-07T17:42:18","modified_gmt":"2025-12-07T17:42:18","slug":"intelligent-energy-consumption-fairness-in-smart-cities","status":"publish","type":"page","link":"http:\/\/vargas-solar.com\/data-centric-smart-everything\/intelligent-energy-consumption-fairness-in-smart-cities\/","title":{"rendered":"Intelligent Energy Consumption &amp; Fairness in Smart Cities"},"content":{"rendered":"\n<p>Students develop a mini-project implemented through four 1-hour challenges.<br>The project focuses on intelligent energy consumption and fairness-aware analytics<br>for smart cities, combining data cleaning, clustering, fairness evaluation, SQL-based<br>sampling, and machine learning modelling.<\/p>\n\n\n\n<p>The four challenges are designed to be done sequentially and build on each other:<\/p>\n\n\n\n<p>1. <a href=\"http:\/\/vargas-solar.com\/data-centric-smart-everything\/challenge-1-data-cleaning-outlier-detection-for-smart-city-energy\/\" data-type=\"page\" data-id=\"593\" target=\"_blank\" rel=\"noreferrer noopener\">Challenge 1<\/a> \u2013 Data Cleaning &amp; Outlier Detection for Smart-City Energy<br>2. <a href=\"https:\/\/gist.github.com\/gevargas\/2876c671b46f511a81b78905d4406e07\" target=\"_blank\" rel=\"noreferrer noopener\">Challenge 2<\/a> &#8211; DEI aware and fairness in data preparation (introduction)<br>2. <a href=\"http:\/\/vargas-solar.com\/data-centric-smart-everything\/challenge-2-data-quality-fairness-sql-sampling-with-aif360\/\" data-type=\"page\" data-id=\"595\" target=\"_blank\" rel=\"noreferrer noopener\">Challenge 2<\/a> \u2013 Data Quality, Fairness &amp; SQL Sampling with AIF360 (application)<br>3. <a href=\"http:\/\/vargas-solar.com\/data-centric-smart-everything\/challenge-3-modelling-smart-city-energy-consumption-with-ml\/\" data-type=\"page\" data-id=\"600\" target=\"_blank\" rel=\"noreferrer noopener\">Challenge 3<\/a> \u2013 Modelling Smart-City Energy Consumption &amp; Fairness of Errors<\/p>\n\n\n\n<p>At the end of the project, you will produce a <strong><em>final infographic<\/em><\/strong> that summarises<br>your workflow, results, and main insights. The description of its content is <a href=\"http:\/\/vargas-solar.com\/data-centric-smart-everything\/final-infographic-project-summary-insights\/\" data-type=\"page\" data-id=\"607\" target=\"_blank\" rel=\"noreferrer noopener\">here<\/a>.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">1. Project Learning Goals<\/h2>\n\n\n\n<p>By completing this project, students should be able to:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Work with a real-world open dataset on smart-city energy consumption.<\/li>\n\n\n\n<li>Apply data-quality checks and statistical data cleaning techniques.<\/li>\n\n\n\n<li>Use k-means clustering to identify atypical days in energy consumption.<\/li>\n\n\n\n<li>Use the IBM AI Fairness 360 (AIF360) library to measure bias in a socio-economic dataset.<\/li>\n\n\n\n<li>Implement fairness-aware sampling strategies using SQL.<\/li>\n\n\n\n<li>Build and evaluate machine learning models for daily energy consumption prediction.<\/li>\n\n\n\n<li>Analyse the fairness of prediction errors across building groups.<\/li>\n\n\n\n<li>Communicate results and insights through a concise, visually engaging infographic.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">2. Datasets Used<\/h2>\n\n\n\n<p><em>2.1 Smart-City Energy Data (Open Power System Data \u2013 Household Data)<\/em><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Source: Open Power System Data (OPSD) \u2013 Household Data package (60-minute resolution).<\/li>\n\n\n\n<li>Example link: https:\/\/data.open-power-system-data.org\/household_data\/2020-04-15\/<\/li>\n\n\n\n<li>Main file used: household_data_60min_singleindex.csv (hourly smart-meter readings).<\/li>\n\n\n\n<li>Role in project:<\/li>\n\n\n\n<li>Used in Challenge 1 to build a cleaned daily energy dataset.<\/li>\n\n\n\n<li>The resulting aggregated dataset (energy_daily_features.csv) is reused in Challenge 3.<\/li>\n<\/ul>\n\n\n\n<p><em>2.2 Socio-Economic &amp; Fairness Data (Adult Census Income Dataset)<\/em><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Source: UCI Machine Learning Repository \u2013 Adult dataset.<\/li>\n\n\n\n<li>Accessed via: IBM AI Fairness 360 (AIF360) library (AdultDataset class).<\/li>\n\n\n\n<li>Role in project:\n<ul class=\"wp-block-list\">\n<li>Used in Challenge 2 to measure bias and experiment with fairness-aware methods.<\/li>\n\n\n\n<li>Provides the classification-based fairness concepts that inspire regression fairness<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>Metrics in Challenge 3.<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Students develop a mini-project implemented through four 1-hour challenges.The project focuses on intelligent energy consumption and fairness-aware analyticsfor smart cities, combining data cleaning, clustering, fairness evaluation, SQL-basedsampling, and machine learning modelling. The four challenges are designed to be done sequentially and build on each other: 1. Challenge 1 &ndash; Data Cleaning &amp; Outlier Detection for [&hellip;]<\/p>\n","protected":false},"author":11,"featured_media":0,"parent":0,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"page-templates\/full-width.php","meta":{"footnotes":""},"class_list":["post-590","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"http:\/\/vargas-solar.com\/data-centric-smart-everything\/wp-json\/wp\/v2\/pages\/590","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/vargas-solar.com\/data-centric-smart-everything\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"http:\/\/vargas-solar.com\/data-centric-smart-everything\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"http:\/\/vargas-solar.com\/data-centric-smart-everything\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"http:\/\/vargas-solar.com\/data-centric-smart-everything\/wp-json\/wp\/v2\/comments?post=590"}],"version-history":[{"count":6,"href":"http:\/\/vargas-solar.com\/data-centric-smart-everything\/wp-json\/wp\/v2\/pages\/590\/revisions"}],"predecessor-version":[{"id":609,"href":"http:\/\/vargas-solar.com\/data-centric-smart-everything\/wp-json\/wp\/v2\/pages\/590\/revisions\/609"}],"wp:attachment":[{"href":"http:\/\/vargas-solar.com\/data-centric-smart-everything\/wp-json\/wp\/v2\/media?parent=590"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}