Data Engineer Associate (225-920)

The role of a Data Engineer Associate is a crucial asset in any organization that's looking to leverage the power of data to drive decision-making and business intelligence. As a Data Engineer Associate, you will work closely with senior data engineers and data architects to design, construct, install, test, and maintain highly scalable data management systems. Employing programming, data management, and analytical skills, you will help transform raw data into meaningful insights that inform strategic and operational decisions. You'll be responsible for building the infrastructure that allows the flow and access of vast amounts of data, ensuring that it is clean, reliable, and ready for analytical or operational use. This position often necessitates collaboration with data scientists, analysts, and business stakeholders to enhance the quality and efficiency of data-driven projects. The ability to process, cleanse, and verify the integrity of data sets, construct complex queries, and create automated dashboards and visualizations is fundamental to this role. This job is perfect for someone with a passion for problem-solving, an eye for detail, and a love for data-driven scrutiny.

Responsibilities

• Develop and maintain scalable data pipelines and build out new integrations.
• Collaborate with data scientists to improve data infrastructure and pipelines.
• Implement methods to improve data reliability and quality, reducing redundancies.
• Build and maintain optimized and highly available data pipelines for large datasets.
• Create dashboards and visualizations for data presentation to stakeholders.
• Write complex SQL queries to extract, transform, and load data effectively.
• Participate in data architecture design and support on-premise or cloud solutions.
• Engage in regular testing and validation of data to ensure quality control standards.
• Document technical specifications and maintain up-to-date accurate records.
• Work closely with IT to ensure data storage needs and governance are met.
• Maintain security and privacy of data through informed technology recommendations.
• Provide insights and technical advice to leverage data for strategic decisions.

Requirements

• Bachelor’s degree in Computer Science, IT, or a related discipline is necessary.
• Proven experience in a data engineering role, preferably in a similar industry.
• Strong proficiency in programming languages such as Python, Java, or Scala.
• Experience with SQL and database management systems like MySQL or PostgreSQL.
• Familiarity with big data tools such as Hadoop, Spark, and Kafka is beneficial.
• Understanding of data warehousing solutions and ETL processes is crucial.
• Excellent problem-solving skills with a strong analytical mind and attention to detail.
• Ability to work effectively in a team environment and communicate complex data.
• Knowledge of cloud environments like AWS, Azure, or Google Cloud Platform is advantageous.