Description:
Our client is looking for a new member of the data team as a Senior Data Engineer to help execute the credit scoring roadmap. The ideal candidate must balance analytical diligence with a willingness to learn and innovate. Required Qualifications:- Bachelor's or Honors degree in Computer Science, Software Engineering, Information Systems, or a related field.
- 4 to 5+ years of experience in data engineering, database administration, or a related field.
- Proficiency in SQL and experience with relational databases such as MySQL, PostgreSQL, or Oracle.
- Experience with data warehousing and ETL tools such as Apache Airflow, Talend, or Informatica.
- Knowledge of data modeling, data architecture, and database design principles.
- Strong programming skills in languages such as Python, Java, or Scala.
- Understanding of distributed systems, cloud infrastructure, and big data technologies such as Hadoop, Spark, or Kafka.
- Knowledge of data governance, data privacy, and regulatory compliance is a plus.
- Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
Key Responsibilities
Data Architecture and Modeling:
- Design and develop data architectures that support the organization's data needs.
- Design and optimize data models to ensure efficient datastorage, retrieval, and analysis.
- Develop and maintain data dictionaries, data lineage, and metadata.
ETL Development and Maintenance:
- Develop and maintain ETL processes to extract, transform, and load data from various sources into data warehouses and data lakes.
- Monitor and troubleshoot ETL processes to ensure timely and accurate data processing.
- Optimize ETL processes for performance, scalability, and maintainability.
Database Design and Administration:
- Design, implement, and maintain databases to support the
- organization's data needs.
- Ensure the security, availability, and reliability of databases
- through monitoring, backup, and recovery procedures.
- Tune database performance to improve query speed and reduce downtime.
- Develop and maintain database documentation and data
- dictionaries.
Requirements:
- Bachelor's or Honors degree in Computer Science, Software Engineering, Information Systems, or a related field.
- 4 to 5+ years of experience in data engineering, database administration, or a related field.
- Proficiency in SQL and experience with relational databases such as MySQL, PostgreSQL, or Oracle.
- Experience with data warehousing and ETL tools such as Apache Airflow, Talend, or Informatica.
- Knowledge of data modeling, data architecture, and database design principles.
- Strong programming skills in languages such as Python, Java, or Scala.
- Understanding of distributed systems, cloud infrastructure, and big data technologies such as Hadoop, Spark, or Kafka.
- Knowledge of data governance, data privacy, and regulatory compliance is a plus.
- Excellent communication and collaboration skills, with the ability to work effectively in a team environment.
- Design and develop data architectures that support the organization's data needs.
- Design and optimize data models to ensure efficient datastorage, retrieval, and analysis.
- Develop and maintain data dictionaries, data lineage, and metadata.
- Develop and maintain ETL processes to extract, transform, and load data from various sources into data warehouses and data lakes.
- Monitor and troubleshoot ETL processes to ensure timely and accurate data processing.
- Optimize ETL processes for performance, scalability, and maintainability.
- Design, implement, and maintain databases to support the
- organization's data needs.
- Ensure the security, availability, and reliability of databases
- through monitoring, backup, and recovery procedures.
- Tune database performance to improve query speed and reduce downtime.
- Develop and maintain database documentation and data
- dictionaries.
10 May 2024;
from:
careers24.com