SMAData

2019-01-06T15:49:23Z

Hasmas:

2019-01-06T15:32:44Z

Hasmas: Hasmas uploaded a new version of "File:SM 2.PNG"

File:SM 2.PNG

2019-01-06T15:23:57Z

Hasmas:

SMAData

2019-01-06T15:02:42Z

Hasmas:

== SMAData (smart meters alarm dataset) SMAData ==

The '''SMAData''' is a new dataset containing power quality alarms from 1033 smart meters for a four months period.

[[File:SM_1.PNG|middle|thumb|400px|caption|"Figure 1: Position and orientation of each accelerometer at the beginning of each experiment. The accelerometer at the right ankle is attached arbitrarily without any pre-defined orientation. The FSRs are instrumented into the shoe soles to collect the ground truth. The data from all sensors is sampled at a frequency of 128 Hz."]]

File:SM 1.PNG

2019-01-06T15:02:07Z

Hasmas:

SMAData

2019-01-06T14:59:31Z

Hasmas: Created page with "== SMAData (smart meters alarm dataset) SMAData == The '''SMAData''' is a new dataset containing power quality alarms from 1033 smart meters for a four months period."

== SMAData (smart meters alarm dataset) SMAData ==

The '''SMAData''' is a new dataset containing power quality alarms from 1033 smart meters for a four months period.

Smart meters' data analysis

2018-10-19T10:21:23Z

Hasmas: Created page with "{{StudentProjectTemplate |Summary=Customer characterization, customer classification and anomaly detection |Keywords=smart meter data, data mining, supervised/unsupervised mac..."

{{StudentProjectTemplate
|Summary=Customer characterization, customer classification and anomaly detection
|Keywords=smart meter data, data mining, supervised/unsupervised machine learning
|Prerequisites=AI and machine learning
|Supervisor=Hassan Nemati, Sławomir Nowaczyk,
|Level=Master
|Status=Open
}}
The aim of the project is to discover features in the smart meters data that can characterize the customer type and behavior, cluster customers, and detect anomalies in electricity consumption.

Hassan Mashad Nemati

2018-07-19T12:36:28Z

Hasmas:

{{Person
|Family Name=Mashad Nemati
|Given Name=Hassan
|Title=Lic. Tech
|Phone=+46 -35 -167930
|Position=PhD Candidate
|Email=hassan.nemati@hh.se
|Image=Hassan.jpg
|Office=E513
}}
{{AssignProjects
|project=EIS-IGS Smart Grids
}}
{{AssignSubjectAreas
|SubjectArea=Computer Science
}}
{{AssignSubjectAreas
|SubjectArea=Data Mining
}}
{{AssignSubjectAreas
|SubjectArea=Learning Systems
}}
{{AssignApplicationAreas
|ApplicationArea=Smart Grids
}}
[[Category:Staff]]


{{ShowPerson}}
{{InsertProjects}}


{{PublicationsList}}

Short-Term Energy Demand Forecasting

2016-10-24T18:12:51Z

Hasmas:

{{StudentProjectTemplate
|Summary=Forecasting the electricity consumption based on historical usage by using smart meter data
|Keywords=load forecasting, demand response
|References=Hong, Wei-Chiang. Intelligent Energy Demand Forecasting. Vol. 10. Springer, 2013.
Ghofrani, M., et al. "Smart meter based short-term load forecasting for residential customers." North American Power Symposium (NAPS), 2011. IEEE, 2011.
http://www.sciencedirect.com/science/article/pii/S1877050914011053
|Prerequisites=Cooperating Intelligent Systems and Learning Systems courses
|Supervisor=Anita Sant'Anna, Sławomir Nowaczyk, Hassan Mashad Nemati,
|Level=Master
|Status=Open
}}
The project is about evaluating different forecasting methods for short term electricity usage and implementing them. There are some available methods e.g. time series, frequency analysis, NN, etc. which student should investigate them and discuss about the most suitable forecasting model.

File:Hassan.jpg

2016-08-29T12:24:50Z

Hasmas: Hasmas uploaded a new version of "File:Hassan.jpg"

2016-01-12T11:30:54Z

Hasmas:

== '''Meeting on 2015 Jan 19''' ==

In this meeting we discussed the following issues:
* HEM mentioned the plan of adding 10 quality measurements for 10 sub-stations. They asked us to provide some suggestions on where we would like to have these measuring devices.
* We have the possibility to setup a meeting with Eltel Company who is responsible for upgrading the smart meters database. At the initial phase the company wanted to do some upgrade on 16 Feb and after that we can have the meeting.
* HEM mentioned that it is possible for them to measure a suspected to failure cable in order to find the weak spot. They currently do this kind of measurement after a failure happens in a cable to localize the broken part.
* Hassan needs to prepare a presentation about the current state of the project and present it for the HEM’s board (Halmstad Kommun). The meeting will be at 19th of February.
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
== '''Meeting on 2014 Nov 18''' ==
In this day the meeting was held in two sessions. The first session was the continuous of the regular monthly meeting with HEM, and the second one devoted to meeting with steering committee regarding to Hassan’s PhD project plan.

;'''Session 1:'''
In this part, Alexander informed us that by the beginning of 2015, ELTEL Company, who is the support company for smart meters, will update the scripts of the managing and modifying software for meters and data concentrators. Also, he said Hassan needs to present his project plan for inner board members of HEM in 19th of Feb.
During the rest of the meeting, the content of the project plan was discussed with Alexander and Peter.

;'''Section 2:'''
In this session, Hassan described his project plan during the next 4.5 years. Antanas Verikas, Stefan Byttner from Halmstad University, Robert Bass from Portland State University, and Ulf Johansson from Borås University were invited as Hassan’s support committee members.
The project plan entitled with “Mining Heterogeneous Data to Improve Reliability and Efficiency of Energy Distribution in Smart Grids” and discussed:
*The motivation of the project (problems from HEM’s perspective),
*Scientific problems in the field of project,
*Resources,
*Methodologies, and
*Goals

Predictive maintenance considered as the most important issue in the project. Predictive maintenance, which addresses problems before they escalate, contains data mining and signal analysis techniques on available data collected from smart meters and other sensors distributed on the grid to predict when maintenance should be performed.
Hassan received very helpful feedbacks from steering committee, and the next update of the project plan was scheduled (May 2015).

-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
== '''Meeting on 2014 Oct 24''' ==
This meeting devoted to the historical failure at HEM’s electricity distribution network. The discussions were based on a document which Hassan had provided. In the following this document is attached:

In order to detect failures in the network and especially in the ground cables, we need to learn about some aspects of the available cables at HEM’s distribution network. We are also interested in the current procedures of detecting faults, determining cause of faults, and ways to fix cables. This information will allow us to investigate the methods for detecting weak spots in the cables and determining what needs maintenance.
We have four discussion topic ideas but we would be more than happy to hear about anything you think would help us.

;'''Types of cables:'''
*Discussion about different types of cables , their quality, strong and weak points
*Most faulty cables, according to their type and impact of the usage and environment

;'''Failures:'''
*Most frequent faults in the system, what can be reasons for their occurrence, what are their symptoms
*Discussion about how you detect faults in the cables (different ways of detecting faults), and how you specify the exact position of fault in a cable. How long does it take to detect the fault or find the faulty part?
*How do you decide what should be done with a faulty cable? Fix? Change? Other operations? What does it depends on?
*Discussion about how you perform the actual fix or change (the procedure of changing or fixing a faulty cable)
*Which types of cables are more sensitive to changes in temperature? Why?
*Discussion about your opinion about the possibilities of predicting different kinds of faults, or for lowering their impact

;'''Maintenance:'''
*Discussion about the typical maintenance operations you perform: what is done, when, where etc.
*The type of cables and the time scheduling for maintenance operations
*Explaining of how you decide what should be done during maintenance

;'''Reporting:'''
*Discussion about how you perform reporting to the system.
*How do you use the historical information e.g. historical faults or historical maintenance?
*Who at HEM uses these reports? What is their main purpose?

;'''Additional discussion:'''
*Discussion about cost of failure in a cable vs cost of maintenance or changing the cable
*Discussion about expensive faults which happen rarely and cheap faults which happen more often
*In your opinion, what are the best ways to reduce the cost (e.g. faster detection, faster operation, predicts failure, better maintenance, etc). What should be taken into account?
*Some examples of historical faults for discussion in terms of: How did you detect what is wrong in the system, specify where the failure is, and decide how to fix it.

-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
== '''Meeting on 2014 Sep 16''' ==

In this meeting we planned to invite an expert from HEM, who is responsible for reporting failures, to discuss about his experience in detecting faults, repairing and reporting them. In this case, Hassan needs to prepare some questions and send them to the expert before the next meeting.

Alexander mentioned the importance of old paper insulated cables which are one of the big causes of failure in their network. Some of these cables are installed in 1929 and needs to be refiled by oil almost every year.

Furthermore, we decided to start changing the meters program with small number of customers. For now 10 small customers (fuse limit below 63A) who are connected to one cable box (N66) are selected. In this regard, Hassan attached 2 documents. One related to the historical information about failures in N66, number of customers, geographical position; and the other one related to the list of additional data we need to collect from smart meters.

The power quality measurement device which are planned to be installed in sub-station N66 will be provided in Jan 2015. There are some old paper insulated cables connected to this sub-station and therefore, it would be a suitable place for monitoring the condition of the grid.

-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
== '''Meeting on 2014 Aug 22''' ==

;'''Presentation:''':
In this meeting, Hassan presented results of collected data from smart meters during 01 June 2013 until 01 June 2014. In this presentation:
*Only customers who are connected to main station H3 are examined.
*Total active power and reactive power consumption (EL consumption) during the specified interval are calculated and demonstrated by different plots.
*The historical fault dataset are used to visualize and investigate any pattern between EL consumption peaks and type of faults.
*Some of anomaly behaviors recorded by customers are specified, i.e. customers with very high, negative, or zero EL consumption.
*Correlation between active power, reactive power, fuse limitation, and number of faults for each customer calculated and depicted with different plots.
*Historical temperature data, extracted from internet, are used to investigate any possible relation between faults and temperature.

;'''Preparing for ELFORSK Conference:''':
In order to be prepared for the conference, some of the issues discussed and planned. “Eleventh Nordic Conference on Electricity Distribution System Management and Development known as NORDAC 2014 will be held at Stockholm in 8 - 9 September by Elforsk.”

;'''Re-Programming Smart Meters in October:''':
It is planned to start choosing most faulty ‘breaking point’ or ‘sub-station’ and then re-programming the connected smart meters in October. In this case, Hassan needs to investigate on the type of parameters that we can collect from smart meters and could be useful for our purposes.

;'''More Historical Data from Smart Meter:''':
It is decided to receive at least one more year data, for customers above 63A, from HEM to investigate how we can forecast EL consumption in the network.
Furthermore, for investigate the proportion of EL consumption in causing faults such as fuse break or overload, smart meters data for customers below 63A is required. Therefore, in addition to the previous data it is decided that HEM provides the daily EL consumption data for small customers.
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
== '''Meeting on 2014 June 02''' ==
In this meeting, Hassan presented results from Historical Fault Data, and Smart Meters Data. In this presentation:
*The distribution of faults related to each year, month, season and hour was shown by using Histogram representation.
*The total active power and reactive power for each customer, connected to the main station H7, during a specific week was shown by scatter plots. In these plots, the maximum current and the number of faults corresponding to each customer was shown by different color and size.
*The total active power and reactive power consumption (for all the customers connected to the main station H7) was shown in 24 hours-7days in the specific week.
*Some of the customers with maximum current above 63A were identified without any corresponding active power or reactive power in smart meters data.

=== '''Activities after meeting:''' ===

;'''Analyzing the Main Station H3:''':
The main station H3 should be analyzed based on the distribution of faults related to each year, month, season and hour. Same analysis which has been performed on main station H7 needs to be done on H3.

;'''Understanding of Missing Data:''':
All of the missing customers in active power and reactive power data files should be detected and the cause of why they are not in the data list should be considered.

;'''Smart Meter:''':
It is important to understand different aspects of smart meter and the types of data it can transfer. In this case, the smart meter datasheet will be investigated and studied. The aim is to be able to evaluate receiving different type of data from smart meters and implementing them at HEM’s laboratory.

;'''Literature Overview:''':
The articles related to: smart meter characteristics and aspects, aging cables and effects on transmitted data needs to be investigated.
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
== '''Activities after meeting (2014/04/28):''' ==

;'''ELFORSK:''':
Elforsk Ltd, which began operations in 1993, is owned by the Swedish Energy and the Swedish National Grid. The overall aim is to rationalize the industry-wide research and development. They provide funding for research and development in this field. [http://www.elforsk.se/Om-Elforsk/]
Eleventh Nordic Conference on Electricity Distribution System Management and Development known as NORDAC 2014 will be held at Stockholm in 8 - 9 September by Elforsk. The aims of the conference is to give the participants to discuss about future challenges and solutions, as well as disseminate experiences regarding technical, economic, and regulatory issues. The topics are very interesting and we decided to participate in the conference.
Webinar for Smart Grid will be held in 9th June by Elforsk. The topics of this Webinar are: the use of controllable loads in power system, future customizing of the smart grid, and voltage fluctuations and regular production. We also plan to attend the Webinar.

;'''Paper for SAIS workshop:''':
Overview of Smart Grid Challenges in Sweden, H. Nemati, A. Sant´Anna, S. Nowaczyk, 28th annual workshop of the Swedish Artificial Intelligence Society (SAIS 2014)- 22,23 May Stockholm.
In this paper we present a brief overview of some of the challenges and solutions in the smart grids, focusing especially on the Swedish point of view. We discuss thirty articles, from 2006 until 2013, with the main interest on data related challenges.
The paper overview gives a general perspective of the available challenges and solutions which can be employed in order to solve similar problems at HEM.

;'''Working with data:''':
At the moment, I start getting familiar with the smart grid distribution system and the user interface (DpPower). Registered failures log from 2000 until May 5, 2014 are collected. Statistical analysis on this data using Python programming language is started.
The data consists of 30 attributes with different values. The type of these values and relation between the attributes are very important and need to be evaluated. Until the next meeting I plan to continue working with the data to find interesting results.

2014-06-03T10:21:40Z

Hasmas:

== '''Meeting on 2014 June 02''' ==
In this meeting, Hassan presented results from Historical Fault Data, and Smart Meters Data. In this presentation:
• The distribution of faults related to each year, month, season and hour was shown by using Histogram representation.
• The total active power and reactive power for each customer, connected to the main station H7, during a specific week was shown by scatter plots. In these plots, the maximum current and the number of faults corresponding to each customer was shown by different color and size.
• The total active power and reactive power consumption (for all the customers connected to the main station H7) was shown in 24 hours-7days in the specific week.
• Some of the customers with maximum current above 63A were identified without any corresponding active power or reactive power in smart meters data.

=== '''Activities after meeting:''' ===

;'''Analyzing the Main Station H3:''':
The main station H3 should be analyzed based on the distribution of faults related to each year, month, season and hour. Same analysis which has been performed on main station H7 needs to be done on H3.

;'''Understanding of Missing Data:''':
All of the missing customers in active power and reactive power data files should be detected and the cause of why they are not in the data list should be considered.

;'''Smart Meter:''':
It is important to understand different aspects of smart meter and the types of data it can transfer. In this case, the smart meter datasheet will be investigated and studied. The aim is to be able to evaluate receiving different type of data from smart meters and implementing them at HEM’s laboratory.

;'''Literature Overview:''':
The articles related to: smart meter characteristics and aspects, aging cables and effects on transmitted data needs to be investigated.
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
== '''Activities after meeting (2014/04/28):''' ==

;'''ELFORSK:''':
Elforsk Ltd, which began operations in 1993, is owned by the Swedish Energy and the Swedish National Grid. The overall aim is to rationalize the industry-wide research and development. They provide funding for research and development in this field. [http://www.elforsk.se/Om-Elforsk/]
Eleventh Nordic Conference on Electricity Distribution System Management and Development known as NORDAC 2014 will be held at Stockholm in 8 - 9 September by Elforsk. The aims of the conference is to give the participants to discuss about future challenges and solutions, as well as disseminate experiences regarding technical, economic, and regulatory issues. The topics are very interesting and we decided to participate in the conference.
Webinar for Smart Grid will be held in 9th June by Elforsk. The topics of this Webinar are: the use of controllable loads in power system, future customizing of the smart grid, and voltage fluctuations and regular production. We also plan to attend the Webinar.

;'''Paper for SAIS workshop:''':
Overview of Smart Grid Challenges in Sweden, H. Nemati, A. Sant´Anna, S. Nowaczyk, 28th annual workshop of the Swedish Artificial Intelligence Society (SAIS 2014)- 22,23 May Stockholm.
In this paper we present a brief overview of some of the challenges and solutions in the smart grids, focusing especially on the Swedish point of view. We discuss thirty articles, from 2006 until 2013, with the main interest on data related challenges.
The paper overview gives a general perspective of the available challenges and solutions which can be employed in order to solve similar problems at HEM.

;'''Working with data:''':
At the moment, I start getting familiar with the smart grid distribution system and the user interface (DpPower). Registered failures log from 2000 until May 5, 2014 are collected. Statistical analysis on this data using Python programming language is started.
The data consists of 30 attributes with different values. The type of these values and relation between the attributes are very important and need to be evaluated. Until the next meeting I plan to continue working with the data to find interesting results.

Internal/HEM Meetings

2014-06-03T10:21:19Z

Hasmas:

== '''Meeting on 2014 June 02''' ==
In this meeting, Hassan presented results from Historical Fault Data, and Smart Meters Data. In this presentation:
• The distribution of faults related to each year, month, season and hour was shown by using Histogram representation.
• The total active power and reactive power for each customer, connected to the main station H7, during a specific week was shown by scatter plots. In these plots, the maximum current and the number of faults corresponding to each customer was shown by different color and size.
• The total active power and reactive power consumption (for all the customers connected to the main station H7) was shown in 24 hours-7days in the specific week.
• Some of the customers with maximum current above 63A were identified without any corresponding active power or reactive power in smart meters data.

= '''Activities after meeting:''' =

;'''Analyzing the Main Station H3:''':
The main station H3 should be analyzed based on the distribution of faults related to each year, month, season and hour. Same analysis which has been performed on main station H7 needs to be done on H3.

;'''Understanding of Missing Data:''':
All of the missing customers in active power and reactive power data files should be detected and the cause of why they are not in the data list should be considered.

;'''Smart Meter:''':
It is important to understand different aspects of smart meter and the types of data it can transfer. In this case, the smart meter datasheet will be investigated and studied. The aim is to be able to evaluate receiving different type of data from smart meters and implementing them at HEM’s laboratory.

;'''Literature Overview:''':
The articles related to: smart meter characteristics and aspects, aging cables and effects on transmitted data needs to be investigated.
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
== '''Activities after meeting (2014/04/28):''' ==

;'''ELFORSK:''':
Elforsk Ltd, which began operations in 1993, is owned by the Swedish Energy and the Swedish National Grid. The overall aim is to rationalize the industry-wide research and development. They provide funding for research and development in this field. [http://www.elforsk.se/Om-Elforsk/]
Eleventh Nordic Conference on Electricity Distribution System Management and Development known as NORDAC 2014 will be held at Stockholm in 8 - 9 September by Elforsk. The aims of the conference is to give the participants to discuss about future challenges and solutions, as well as disseminate experiences regarding technical, economic, and regulatory issues. The topics are very interesting and we decided to participate in the conference.
Webinar for Smart Grid will be held in 9th June by Elforsk. The topics of this Webinar are: the use of controllable loads in power system, future customizing of the smart grid, and voltage fluctuations and regular production. We also plan to attend the Webinar.

;'''Paper for SAIS workshop:''':
Overview of Smart Grid Challenges in Sweden, H. Nemati, A. Sant´Anna, S. Nowaczyk, 28th annual workshop of the Swedish Artificial Intelligence Society (SAIS 2014)- 22,23 May Stockholm.
In this paper we present a brief overview of some of the challenges and solutions in the smart grids, focusing especially on the Swedish point of view. We discuss thirty articles, from 2006 until 2013, with the main interest on data related challenges.
The paper overview gives a general perspective of the available challenges and solutions which can be employed in order to solve similar problems at HEM.

;'''Working with data:''':
At the moment, I start getting familiar with the smart grid distribution system and the user interface (DpPower). Registered failures log from 2000 until May 5, 2014 are collected. Statistical analysis on this data using Python programming language is started.
The data consists of 30 attributes with different values. The type of these values and relation between the attributes are very important and need to be evaluated. Until the next meeting I plan to continue working with the data to find interesting results.