Data is a vital part of our business and with your help, we can improve the services that we provide to our customers through engineering excellence of our data products. You’ll be working on exciting data products which support TV, Broadband, Digital Voice and market leading technologies like Unbreakable Wi-Fi. We deliver these critical services using the latest cloud technologies on AWS, GCP and Cloudera.
When you join us as a lead data engineer, you’ll have the opportunity to be part of our Data & AI Enablement Team where you will help to design, build, and support high quality engineering products from our extensive data sources and multi-cloud environment.
As a team we believe in the agile principles of openness, transparency and continuous improvement, which underpin strong relationships with our business stakeholders.
There will be lots of opportunities to explore new technologies, develop new skills, innovate and grow as an engineer.
Design, develop, and maintain end-to-end data pipelines using Ab Initio (GDE, PDL, Conduct>IT, Express>IT).
Build scalable batch and streaming workloads using Apache Spark (PySpark/Scala).
Develop and orchestrate data ingestion flows using Apache NiFi for real-time and near-real-time use cases.
Optimize ETL/ELT jobs for scalability, throughput, and resource efficiency.
Perform bottleneck analysis and tuning for Spark jobs, NiFi processors, and Ab Initio graphs.
Demos and knowledge transfers to stakeholders around product developments.
Spread your experience and knowledge to junior engineers.
Improve automated testing and deployments using CI/CD pipelines.
Expectation to line manage small team of junior data engineers.
Continual learning through internal and external training.
What You’ll Be Doing
Use of Hadoop, GCP or AWS to build Big Data solutions using some of the following technologies: Scala, Java, Python, Spark,
Hands-on experience with Continuous Integration and Deployment Strategies Prior experience using Confluence, JIRA, or other Atlassian tools.
Software version control using git or SVN.
Presentation of technical issues and successes to other members of the team and to Product Owners.
Keen interest in learning new technologies and putting these into practice.
Has experience of people management or desire to manage individuals on the tea
At BT International, our purpose is to keep the world connected. As part of BT, we build on almost 180 years of innovation and expertise to deliver secure connectivity and digital services to some of the world’s leading multinational businesses and organisations. Our customers trust us to safeguard their data, drive their digital transformation and keep their businesses running. With colleagues on the ground across the world and supporting customers wherever they need to operate, BT International offers a truly global experience. Whether it’s about providing cloud connectivity, helping organisations collaborate, or enabling innovation in cybersecurity and digital services, you’ll be part of a team that shapes how businesses succeed in a world that is being transformed by AI. If you have the drive and ambition to make an impact on a global stage, BT International is where it happens.
Searching, interviewing and hiring are all part of the professional life. The TALENTMATE Portal idea is to fill and help professionals doing one of them by bringing together the requisites under One Roof. Whether you're hunting for your Next Job Opportunity or Looking for Potential Employers, we're here to lend you a Helping Hand.
Disclaimer: talentmate.com is only a platform to bring jobseekers & employers together.
Applicants
are
advised to research the bonafides of the prospective employer independently. We do NOT
endorse any
requests for money payments and strictly advice against sharing personal or bank related
information. We
also recommend you visit Security Advice for more information. If you suspect any fraud
or
malpractice,
email us at abuse@talentmate.com.
You have successfully saved for this job. Please check
saved
jobs
list
Applied
You have successfully applied for this job. Please check
applied
jobs list
Do you want to share the
link?
Please click any of the below options to share the job
details.
Report this job
Success
Successfully updated
Success
Successfully updated
Thank you
Reported Successfully.
Copied
This job link has been copied to clipboard!
Apply Job
Upload your Profile Picture
Accepted Formats: jpg, png
Upto 2MB in size
Your application for Data Engineering Specialist
has been successfully submitted!
To increase your chances of getting shortlisted, we recommend completing your profile.
Employers prioritize candidates with full profiles, and a completed profile could set you apart in the
selection process.
Why complete your profile?
Higher Visibility: Complete profiles are more likely to be viewed by employers.
Better Match: Showcase your skills and experience to improve your fit.
Stand Out: Highlight your full potential to make a stronger impression.
Complete your profile now to give your application the best chance!