Data Engineer - Associate 24N25

As a Data Engineer - Associate 24N25, you will play a crucial role in constructing, designing, and maintaining scalable data pipelines capable of handling vast amounts of information efficiently. In this position, you will work collaboratively with data scientists and analysts to optimize data systems, ensuring seamless data flow to fulfill the organization's analytics requirements. The ideal candidate will possess strong problem-solving skills, a keen eye for detail, and experience with cloud-based data environments. Your expertise will aid in enhancing the quality and accessibility of data across the organization, thereby enabling informed decision-making and strategic business initiatives.

Responsibilities

• Develop, construct, and maintain robust data pipeline architectures and systems.
• Ensure optimal data delivery architecture is consistent through ongoing projects.
• Collaborate with data scientists to develop and scale tools for analytics needs.
• Implement data flow and collection for cross-departmental data sources.
• Build analytics tools that utilize data pipelines to provide actionable insights.
• Work closely with executives and other stakeholders to support data infrastructure needs.
• Proactively identify opportunities to improve data accessibility and quality.
• Employ large-scale data processing to maintain and expand data pipelines.
• Conduct validation and testing of data processing systems for reliability.
• Develop documentation and best practices for data management and processing workflows.
• Analyze complex datasets to extract insight and collaborate with reporting teams.
• Ensure adherence to data management policies and maintain data security protocols.

Requirements

• Bachelor's degree in Computer Science, Information Technology, or related field preferred.
• Proficiency in SQL and experience with big data technologies like Hadoop or Spark.
• Experience with cloud data solutions, such as AWS, Google Cloud, or Azure.
• Strong programming skills, particularly with Python, Java, or Scala for data processing.
• Familiarity with data modeling, ETL development, and reporting techniques.
• Understanding of data warehousing concepts and database management systems.
• Excellent problem-solving abilities and capacity to troubleshoot data issues effectively.