Recruitment news
AWS Data Engineer
Location: | Johannesburg |
Remote work: | Some remote work allowed |
Type: | Permanent |
Reference: | #NG59270 |
Company: | E-Merge IT Recruitment |
Pioneers in harnessing the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide whose and vision is to provide next generation actionable insights to every company, globally, by harnessing the value of data using high performance, interoperable and simplified solutions are currently looking for an AWS Data Engineer to join their fast-paced and dynamic team!
Responsibilities
- Design, build and operationalise large scale enterprise data solutions and applications
- Analyse, re-architect and re-platform on-premise data warehouses to data platforms on AWS cloud using AWS or 3rd party services and Kafka CC.
- Design and build production data pipelines from ingestion to consumption within a big data architecture, using Java, PySpark, Scala, Kafka CC.
- Design and implement data engineering, ingestion and curation functions on AWS cloud using AWS native or custom programming.
- Perform detail assessments of current state data platforms and create an appropriate transition path to AWS cloud.
- Design, implement and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power.
- Interface with other technology teams to extract, transform, and load data from a wide variety of data sources using SQL, AWS big data technologies and Kafka CC.
- Create and support real-time data pipelines built on AWS technologies including Glue, Lambda, Step Functions, PySpark, Athena and Kafka CC.
- Continual research of the latest big data and visualization technologies to provide new capabilities and increase efficiency.
Qualifications and experience:
- Bachelor's degree in computer science, information technology, or other relevant fields
- 5 – 8 years’ experience
- Has experience in any of the following AWS Athena and Glue Pyspark, DynamoDB, Redshift, Lambda, Step Functions and Kafka CC
- Proficient in AWS Redshift, S3, Glue, Athena, PySpark, Step Functions, Glue Workflows, Kafka CC, Delta.io
- Knowledge of software engineering best practices across the development lifecycle
- Experience with big data tools is a must: Delta.io, PySpark, Kafka, etc.
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
Are you ready for a change of scenery? E-Merge IT recruitment is a specialist niche recruitment agency. We offer our candidates options so that we can successfully place the right developers with the right companies in the right roles. Check out the E-Merge website www.e-merge.co.za for more great positions.
Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals
Posted on 30 Aug 13:24, Closing date 29 Oct
Data Engineer - Azure and Fabric
An IT solutions company dedicated to transforming data into actionable insights that drive business decisions is looking for a talented data engineer to join its dynamic...
Senior Data Engineer - Azure
A technology and analytics-driven consulting company empowering clients by solving real-world business challenges that deliver tangible value, with core capabilities...
Electrical Engineer
A company based in Pretoria East is hiring an electrical engineer to work on a diverse range of projects in the public and private sectors.
Senior C# Software Engineer
Ready to dive into the world of next-gen identity verification software? Our vibrant team in the heart of Johannesburg is on the hunt for a Senior C# Software Engineer...
Senior DevOps Engineer
We design for the shapeshifters and deliver products and services that make us incredibly proud of the people who make it happen.
Structural Engineer/Technologist
We are looking for a skilled structural engineer /technologist to provide comprehensive civil and structural engineering services.
Quality Engineer - Software Test Specialist
We are seeking an experienced and self-motivated seasoned Quality Assurance Engineer to join our Agile Team.
Python AWS Software Engineer
Are you ready to pursue a fulfilling career in software development? A prominent player in the field of telecoms big data invites you to join our platform team, the team...
Fullstack Java DevOps Engineer
We focus on innovation topics as well as comprehensive IT solutions such as development and operations for ERP, JAVA, Azure and Cloud solutions.
Machine Learning Engineer
A group providing value-conscious mass-marketing to customers in Southern Africa and leaders in providing innovative financial services have an opportunity for a Machine...
Process Engineer
Job purpose The purpose of this role is for the centre of excellence specialist to oversee the implementation of business analysis standards and practices.
Senior Azure Data Engineer
An autonomous Namibian bank, providing superior financial services to individual and corporate clients, as well as international banking services by liaising directly...
Data Analyst/Engineer
A group with an in-house system that runs all their businesses from life insurance to unit trusts including bringing impact farming to utilities management.
Data Engineer - Azure
A leading telecommunications company, with innovative solutions from designing, building, deploying, and managing high performance computing infrastructure and an...
Senior C# Software Engineer
Ready to dive into the world of next-gen identity verification software? Our vibrant team in the heart of Johannesburg is on the hunt for a Senior C# Software Engineer...
Sound Engineer
Are you passionate about creating unforgettable audio experiences? Do you thrive in high-energy environments and love the thrill of live events? If so, we want...
Senior Data Engineer - Azure
A technology and analytics driven consulting company empowering clients by solving real-world business challenges that deliver tangible value and count their core...
Azure Data Engineer
A long serving bank known as Africa's biggest lender of assets and financial services group committed to providing banking insurance and asset management services have...
Senior Software Engineer - Python
A health tech company seeking to lower the cost of quality care to improve access are looking for a Senior Software Engineer (Python).
AWS Data Engineer
Our valued client, a leader in African capital markets and a powerhouse in the automotive industry, is renowned for its diverse product offerings and global reach.
ERP System Software and Hardware Engineer
Our client in the commercial automotive industry is looking for an ERP system software and hardware engineer to join their company in the East Rand area.
Senior Azure Data Engineer
A long serving bank known as Africa's biggest lender of assets and financial services group committed to providing banking insurance and asset management services have...
Junior Data Engineer - Power BI
As a junior data engineer, you will contribute to the development of their revolutionary compliance service platform, the engineer will play a crucial role in...
Senior Cloud Engineer / Developer (C# / Azure)
New work at an African digital tech hub with a core focus on user experience design, web and mobile tech as well as machine learning.
AWS Data Engineer
Pioneers in harnessing the power of Artificial Intelligence (AI) to deliver actionable insights and drive transformative change for businesses worldwide whose and vision...
Senior Data Engineer - Azure
New work in at a leading innovator in the tech industry, dedicated to providing cutting-edge solutions that drive business success with clients Globally.
Senior C# Full Stack Software Engineer - Node.js + Angular
New wirk in at an award-winning Biometrics and identity verification Tech shop at the forefront of fintech and software solutions! The current need is for a dynamic and...
Senior Software Engineer - Python and C#
This leading innovator in cloud-based solutions is currently seeking a senior python/C# software engineer to join their team.
Senior C# Full Stack Software Engineer
Join the excitement! Ever dreamed of diving into the finance, trading, and capital markets cosmos while coding your way to glory? Here's your chance!...
Senior C# Full Stack Software Engineer
New work in an award-winning Biometrics and identity verification tech shop at the forefront of fintech and software solutions! The current need is for a dynamic...