IT Industry News. Daily.
We are seeking a highly motivated and experienced AWS Data Engineer to join our Global Markets division. In this role, you will work closely with our traders, quantitative analysts, and data scientists to design, develop, and maintain data infrastructure and pipelines for our global markets business.
The ideal candidate should have a strong background in C# or Python programming and building data pipelines on AWS, especially with AWS Glue Jobs using PySpark or AWS Glue Spark. This role offers an exciting opportunity to collaborate with leading financial institutions, contributing to the design and implementation of data pipelines to support global markets business. It will be advantageous if the candidate has the AWS Certified Machine Learning – Specialty Certificate or can develop machine learning models and automate ML pipelines.Requirements: Bachelor’s degree in Computer Science, Information Systems, or related field.Responsibilities differ across client engagements but may include: Creating data models that can be used to extract information from various sources and store it in a usable format. Lead the design, implementation, and successful delivery of large-scale, critical, or difficult data solutions involving a significant amount of data.Ability to ingest data into AWS S3, perform ETL into RDS or Redshift.Designing and implementing security measures to protect data from unauthorized access or misuse.Work on automating the migration process in AWS from development to production. You will deliver digestible, contemporary, and immediate data content to support and drive business decisions. You will be involved in all aspects of data engineering from delivery planning, estimating and analysis, all the way through to data architecture and pipeline design, delivery, and production implementation. From day one, you will be involved in the design and implementation of complex data solutions ranging from batch to streaming and event-driven architectures, across cloud, on-premise and hybrid client technology landscapes.QUALIFICATIONS AND COMPETENCIESRealtime ingestion using KAFKA is an added advantage.Objective oriented principles in C# or Python: classes and inheritance.AWS technical certifications . Experience with development and delivery of microservices using serverless AWS services .Have experience working with RDBMS databases, such as Postgres, SQL Server and MySQL. Apply knowledge of scripting and automation using tools like PowerShell, Python, Bash, Ruby, Perl, etc. Stakeholder management and communication skills, including prioritizing, problem solving and interpersonal relationship building.Strong experience in SDLC delivery, including waterfall, hybrid, and Agile methodologies.Experience in implementing and delivering data solutions and pipelines on AWS Cloud Platform.An in-depth understanding of large-scale data sets, including both structured and unstructured data.Ability to clearly communicate complex technical ideas.An AWS Certified Machine Learning – Specialty Certificate is an advantage. If you are passionate about working with data and have a desire to work in a dynamic and challenging environment, we encourage you to apply. This is an excellent opportunity to make a significant impact in a leading investment bank and to grow your career in data engineering
United States Latest News, United States Headlines
Similar News:You can also read news stories similar to this one that we have collected from other news sources.
Data Engineer - IT-OnlineIT Industry News. Daily.
Read more »
Data Engineer - Gauteng SandownIT Industry News. Daily.
Read more »
Senior Software Engineer - IT-OnlineIT Industry News. Daily.
Read more »
Senior Support Engineer - IT-OnlineIT Industry News. Daily.
Read more »
Senior Data Engineer - Western Cape WoodstockIT Industry News. Daily.
Read more »
Data Engineer - IT-OnlineIT Industry News. Daily.
Read more »