![ITI Data](https://media.trabajo.org/img/noimg.jpg)
AWS Data Engineer
4 weeks ago
Job Description
We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There is no requirement for Machine Learning skills. This is a high visibility, fast-paced key initiative will integrate data across internal and external sources, provide analytical insights, and integrate with the customer’s critical systems.
Key Responsibilities
• Design, build and unit test applications on Spark framework on Python.
• Build Python and PySpark based applications based on data in both Relational databases (e.g. Oracle), NoSQL databases (e.g. DynamoDB, MongoDB) and filesystems (e.g. S3, HDFS)
• Build AWS Lambda functions on Python runtime leveraging pandas, json, boto3, requests, avro libraries
• Build PySpark based data pipeline jobs on AWS Glue ETL requiring in-depth knowledge on AWS Glue Dynamic Frames and Options
• Build Python based event-driven integration with Kafka Topics, leveraging Confluent Kafka libraries
• Design and Build Generic, Reusable utility applications in Python
• Build the Python programs across Glue ETL jobs and Lambda functions
• Optimize performance for data access requirements by choosing the appropriate native Hadoop file formats (Avro, Parquet, ORC etc) and compression codec respectively.
• Design & Build S3 buckets, tiers, lifecycle policies, as strategic storage layer for "Data Lake"
• Optimize performance of Spark applications in Hadoop using configurations around Spark Context, Spark-SQL, Data Frame, and Pair RDD's
• Setup the Glue crawlers in order to catalog OracleDB tables, MongoDB collections and S3 objects
• Configure Athena tables and SQL views based on Glue Cataloged datasets
• Ability to monitor, troubleshoot and debug failures using AWS CloudWatch and Datadog
• Ability to solve complex data-driven scenarios and triage towards defects and production issues
• Participate in code release and production deployment.
-
AWS Data Engineer
4 months ago
Delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
AWS Data Engineer
1 month ago
delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
Aws data engineer
4 weeks ago
Delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
delhi, India Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
Data Warehouse Engineer
2 weeks ago
Delhi, India Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
AWS Data Engineer
2 months ago
delhi, India FLYONIT Full timeJob Summary: We are looking for a highly skilled AWS Data Engineer with 5-6 years of experience to join our dynamic team. The ideal candidate will have hands-on experience with AWS services, data engineering best practices, and a strong understanding of building, deploying, and maintaining data pipelines in the cloud. You will be responsible for designing...
-
AWS Data Engineer
4 weeks ago
delhi, India FLYONIT Full timeJob Summary:We are looking for a highly skilled AWS Data Engineer with 5-6 years of experience to join our dynamic team. The ideal candidate will have hands-on experience with AWS services, data engineering best practices, and a strong understanding of building, deploying, and maintaining data pipelines in the cloud. You will be responsible for designing and...
-
AWS Data Engineer
3 months ago
delhi, India FLYONIT Full timeJob Summary:We are looking for a highly skilled AWS Data Engineer with 5-6 years of experience to join our dynamic team. The ideal candidate will have hands-on experience with AWS services, data engineering best practices, and a strong understanding of building, deploying, and maintaining data pipelines in the cloud. You will be responsible for designing and...
-
AWS Data Engineer
1 month ago
delhi, India FLYONIT Full timeJob Summary:We are looking for a highly skilled AWS Data Engineer with 5-6 years of experience to join our dynamic team. The ideal candidate will have hands-on experience with AWS services, data engineering best practices, and a strong understanding of building, deploying, and maintaining data pipelines in the cloud. You will be responsible for designing and...
-
Aws data engineer
1 month ago
Delhi, India FLYONIT Full timeJob Summary:We are looking for a highly skilled AWS Data Engineer with 5-6 years of experience to join our dynamic team. The ideal candidate will have hands-on experience with AWS services, data engineering best practices, and a strong understanding of building, deploying, and maintaining data pipelines in the cloud. You will be responsible for designing and...
-
AWS Data Engineer
1 month ago
delhi, India FLYONIT Full timeJob Summary:We are looking for a highly skilled AWS Data Engineer with 5-6 years of experience to join our dynamic team. The ideal candidate will have hands-on experience with AWS services, data engineering best practices, and a strong understanding of building, deploying, and maintaining data pipelines in the cloud. You will be responsible for designing and...
-
AWS Data Engineer
1 day ago
Delhi, India Kratos Gamer Network Full timeAbout KGeN:KGeN (Kratos Gamer Network) is building a multi-chain gamer network that aims to become the home of global gamer data, owned by gamers. At the heart of it is the revolutionary Proof of Gamer (P.O.G) Engine that allows gamers to build, own & monetise their reputation. This data framework allows game publishers to engage with precise gamer cohorts,...
-
AWS Data Engineer
1 week ago
Delhi, India VicTree Solutions Full timeJob Title: AWS Data Engineer (exp: 5+ years)Job Location: Pune, MaharashtraContract RoleJob Brief:We are seeking a skilled AWS Data Engineer to join our team. The ideal candidate will have a strong backgroundin building, managing, and optimizing large-scale data pipelines and data lakes on AWS. This role requires hands- on experience with AWS cloud services,...
-
AWS Data Engineer
4 weeks ago
delhi, India Recro Full timeJob Title: AWS Data Engineer Location - Remote Experience - 3+ years Note- Looking for candidates who have experience working from the scratch and are currently serving their notice period, with availability to join within 10-15 days. We are seeking a Data Engineer with strong hands-on experience in data engineering techniques to create data pipelines...
-
AWS Data Engineer
1 week ago
Delhi, India Recro Full timeJob Title: Data Engineer Experience : 5+ yearsLocation : RemoteJob Type : Full-timeRole Overview:We are seeking an experienced Data Engineer to develop and optimize data pipelines and manage cloud infrastructure. The ideal candidate has strong Python, Pyspark, and AWS skills, with a focus on performance optimization and clean, maintainable code.Key...
-
Aws data engineer
2 weeks ago
Delhi, India Recro Full timeJob Title: Data EngineerExperience : 5+ yearsLocation : RemoteJob Type : Full-timeRole Overview:We are seeking an experienced Data Engineer to develop and optimize data pipelines and manage cloud infrastructure. The ideal candidate has strong Python, Pyspark, and AWS skills, with a focus on performance optimization and clean, maintainable code.Key...
-
AWS Data Engineer
2 weeks ago
Delhi, India Recro Full timeJob Title: Data EngineerExperience : 5+ yearsLocation : RemoteJob Type : Full-timeRole Overview:We are seeking an experienced Data Engineer to develop and optimize data pipelines and manage cloud infrastructure. The ideal candidate has strong Python, Pyspark, and AWS skills, with a focus on performance optimization and clean, maintainable code.Key...
-
Aws data engineer
7 days ago
Delhi, India VicTree Solutions Full timeJob Title: AWS Data Engineer (exp: 5+ years) Job Location: Pune, MaharashtraContract RoleJob Brief:We are seeking a skilled AWS Data Engineer to join our team. The ideal candidate will have a strong backgroundin building, managing, and optimizing large-scale data pipelines and data lakes on AWS. This role requires hands- on experience with AWS cloud...
-
AWS Data Engineer
1 day ago
Delhi, India Tata Consultancy Services Full timeDear Candidate,Greetings from TATA CONSULTANCY SERVICES LIMITED!!!Skill:AWS Data Engineer + Python & ScalaLocation:PAN INDIAExperience:4 to 8 yearsIndustry experience in Data Engineering on AWS cloud with glue, redshift , Athena experience.Ability to write high quality, maintainable, and robust code, often in SQL, Scala and Python.3+ Years of Data Warehouse...
-
AWS Data Engineer
4 weeks ago
delhi, India Recro Full timeJob Title: AWS Data Engineer Location - RemoteExperience - 3+ yearsNote- Looking for candidates who have experience working from the scratch and are currently serving their notice period, with availability to join within 10-15 days.We are seeking a Data Engineer with strong hands-on experience in data engineering techniques to create data pipelines and...