Data Engineer

Description:

• The integration of data from multiple sources: organized, disorganized, structured and/or unstructured, into a centralized data repository.
• Creating and evolving data models, schemas and repositories to efficiently store and process data, accomplishing this through well designed, implemented and maintained ETL pipelines.
• The data engineer will be responsible for the detailed cataloguing of all data assets within the company (from his/her area of responsibility), not only for own use, but also to assist data professionals as they analyse available data.
• Data quality and governance will be ensured and enforced by designing and implementing data quality standards, as well as governance policies, holding him/her accountable for architectures and/or data systems that promote data reliability, scalability and quality.
• The engineer will ensure data security and compliance to privacy regulations by developing and implementing the required security protocols and access controls.
• Throughout all this he/she will continually optimize the data repository’s query and processing performance, ensuring quick and efficiently processed data.
• Internally the engineer has direct interfaces and interaction with the Production and Distribution departments (client oriented), the Engineering department (Control and measuring interfaces, both client and provider oriented), Technical (process optimization, client oriented), OPS Planning (scheduling aspects, client oriented), and other IT Teams (L2, L3 and L4 teams, main providers).
• Externally the engineer would liaise with external system suppliers, process/data technology consultants, and application software suppliers. Cooperation with external stakeholders like customers and/or suppliers are also frequent, in order to integrate external data systems with systems. Special working conditions Overtime may be required.

• Gr12 with Maths and Science
• A Bachelor's or Master’s degree in Computer Science, Data Science, or related field with 6 years’ relevant experience(Grade5), 4 years’ experience (Grade6) or 2 years’ experience (Grade7).
• Minimum of 2 years Project management experience.
• Minimum of 4 years Data engineering principles and best practices experience.
• Minimum of 3 years Software design and engineering principles experience.
• Minimum of 4 years Data modelling, Data integration (ETL), System architecture design and System optimisation experience.
• Minimum 2 years Production process knowledge in terms of steelmaking, metallurgy, material routing
• Technical skills, Management skills, People skills, Personal competencies, Personal competencies skills and Administrative skills

Requirements:

• The integration of data from multiple sources: organized, disorganized, structured and/or unstructured, into a centralized data repository.
• Creating and evolving data models, schemas and repositories to efficiently store and process data, accomplishing this through well designed, implemented and maintained ETL pipelines.
• The data engineer will be responsible for the detailed cataloguing of all data assets within the company (from his/her area of responsibility), not only for own use, but also to assist data professionals as they analyse available data.
• Data quality and governance will be ensured and enforced by designing and implementing data quality standards, as well as governance policies, holding him/her accountable for architectures and/or data systems that promote data reliability, scalability and quality.
• The engineer will ensure data security and compliance to privacy regulations by developing and implementing the required security protocols and access controls.
• Throughout all this he/she will continually optimize the data repository’s query and processing performance, ensuring quick and efficiently processed data.
• Internally the engineer has direct interfaces and interaction with the Production and Distribution departments (client oriented), the Engineering department (Control and measuring interfaces, both client and provider oriented), Technical (process optimization, client oriented), OPS Planning (scheduling aspects, client oriented), and other IT Teams (L2, L3 and L4 teams, main providers).
• Externally the engineer would liaise with external system suppliers, process/data technology consultants, and application software suppliers. Cooperation with external stakeholders like customers and/or suppliers are also frequent, in order to integrate external data systems with systems. Special working conditions Overtime may be required.

• Gr12 with Maths and Science
• A Bachelor's or Master’s degree in Computer Science, Data Science, or related field with 6 years’ relevant experience(Grade5), 4 years’ experience (Grade6) or 2 years’ experience (Grade7).
• Minimum of 2 years Project management experience.
• Minimum of 4 years Data engineering principles and best practices experience.
• Minimum of 3 years Software design and engineering principles experience.
• Minimum of 4 years Data modelling, Data integration (ETL), System architecture design and System optimisation experience.
• Minimum 2 years Production process knowledge in terms of steelmaking, metallurgy, material routing
• Technical skills, Management skills, People skills, Personal competencies, Personal competencies skills and Administrative skills