Big Data Engineer - GCP

Specific Duties And Responsibilities

• Support data pipelines within BI GCP and BI Teradata production environments
• Support and troubleshoot technical problems within BI GCP and BI Teradata environments
• Share technical expertise with team and provide recommendations for best practices
• Support production processes within BI teams
• Support outages, delays & major deployments within the GCP environment and help maintain the GCP infrastructure for the team
  
  

• At least 3 years of experience with scripting using SQL including writing, troubleshooting, querying, evaluating, and optimizing codes
• At least 3 years of experience with GCP and tools such as Dataproc, Cloud Composer, Airflow, Dataflow, Datafusion
• At least 3 years of experience with Data Analysis specific to investigation, troubleshooting, and resolution for issues
• At least 3 years of experience with ETL and relational databases such as Teradata, Oracle, SQL Server, and Big Query
• Knowledgeable with Gitlab, VSCode, IDEs, CI/CD, including deployment practices
  
  

• Familiarity with Jira for ticketing and Confluence
• Experience with Big Data and unstructured data technologies including HDFS, Spark, Map Reduce, Hive, Impala, Cloudera, NoSQL, Oozie, Sqoop
• Knowledgeable with Shell scripting, Python, or Bash scripting
• Ability to demonstrate analytical and problem-solving skills, particularly those that apply to a GCP environment
• Ability with troubleshooting code written by other people, including understanding the business logic implemented and ensuring the code is optimal
• Ability to prioritize, multitask and execute tasks in a high-pressure environment
• Strong verbal and written communication skills
• Collaborative spirit to share learnings and knowledge with peers
• Interpersonal skills and good communication skills
• Eager and receptive to learn new skills and tools
  
  

• Bachelor’s Degree in Computer Science, Information Technology, Engineering, or Business Administration
  
  

• Hybrid Setup – once a month onsite in San Mateo, Rizal
• Amenable to work on a Mid Shift (3 PM – 12 AM), with one month Night Shift (8 PM – 5 AM) for training and onboarding