Aws Data Engineer – Oil
3 weeks ago
The ideal candidate will have strong experience in AWS cloud services, data engineering and knowledge of Oil & Gas upstream, midstream or downstream processes to support advanced analytics, reporting, and digital transformation initiatives.
Key Responsibilities:
• Design, develop, and maintain scalable data pipelines and ETL/ELT solutions using AWS cloud services.
• Ingest, process, and store structured/unstructured data from multiple sources (Io T devices, sensors, ERP systems, drilling logs, production data, etc.).
• Implement data lake and data warehouse solutions
• Optimize data pipelines for performance, cost and scalability.
• Collaborate with domain experts, data scientists and business analysts to translate Oil & Gas business requirements into data solutions.
• Ensure data governance, data quality and security compliance.
• Support real-time data streaming and analytics using AWS services (Kinesis, Kafka, Lambda).
• Document technical solutions and provide knowledge transfer to the team.
• Proficiency in AWS services:- S3, Redshift, Glue, Athena, EMR, Lake Formation- Lambda, Kinesis, Step Functions, Cloud Watch, RDS, Dynamo DB (optional)
• Expertise in ETL/ELT development using Py Spark, Python, or SQL.
• Experience with data modeling, warehousing, and performance tuning.
• Knowledge of data lake and modern data architecture.
• Strong SQL skills and ability to work with large datasets.
• Hands-on with CI/CD and Dev Ops practices for data solutions.
• Familiarity with Oil & Gas industry datasets and use cases (production, drilling, exploration, sensor/Io T data).
• Candidate will also be judged in following skills:- Understanding of data ingestion pattern.- Extensive knowledge of data bricks & Azure Data Factory- SQL Knowledge- Incremental & Append data load
-
AWS Data Engineer
2 weeks ago
India DigiHelic Solutions Pvt. Ltd. Full timeKey Responsibilities: • Design, develop, and maintain scalable data pipelines and ETL/ELT solutions using AWS cloud services. • Ingest, process, and store structured/unstructured data from multiple sources (IoT devices, sensors, ERP systems, drilling logs, production data, etc.). • Implement data lakeand data warehouse solutions • Optimize data...
-
Aws Data Engineer
1 week ago
India Adastra Corp Full timeAs an AWS Data Engineer, you will be responsible for: Technical requirements gathering and development of functional specificationsCommunicating with technical contacts regarding incoming and outgoing data interfacesImplementing the data pipelinesDevelop and implement best practices for AWS applications: Data Integration, Analytics & ReportingCreate ETL jobs...
-
AWS Data Engineer
22 hours ago
Chennai, India Crescent Techservices Full timeJob Description Role: AWS Data Engineer Type: 6-12 month contract Location: Chennai, Tamil Nadu (WFO) Experience: 6-8 Years Requirements: - Proficiency in Python and PySpark: Strong experience writing robust Python code and utilizing PySpark for distributed data processing, transformation, and working with large datasets. - AWS Data Engineering...
-
Freelance AWS Data Engineer
3 weeks ago
India ThreatXIntel Full timeJob DescriptionCompany DescriptionThreatXIntel is a startup cyber security company focused on protecting businesses and organizations from cyber threats. Our services include cloud security, web and mobile security testing, cloud security assessment, and DevSecOps. We provide customized, affordable solutions to meet the specific needs of our clients,...
-
Senior AWS Data Engineer
3 weeks ago
India CYAN360 Full timePosition: Senior AWS Data Engineer Location: Remote Salary: Open Work Timings: 2:30 PM to 11:30 PM IST *** Need someone who can join immediately or in 15 days*** Responsibilities: Design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc. Implement data...
-
Senior AWS Data Engineer
2 weeks ago
India CYAN360 Full timePosition: Senior AWS Data Engineer Location: Remote Salary: Open Work Timings: 2:30 PM to 11:30 PM IST *** Need someone who can join immediately or in 15 days*** Responsibilities: Design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc. ...
-
Python aws data engineer
3 days ago
India Digitrix Software LLP Full timeExperience : 5 to 8 years Job description: Python AWS Data Engineer Python, AWS Python (core language skill) -- Backend, Pandas, Py Spark (Data Frame API), interacting with AWS (e.g., boto3 for S3, Glue, Lambda) Data Processing: Spark (Py Spark), Glue, EMR AWS Core Services: S3, Glue, Athena, Lambda, Step Functions, EMR Containerization: Docker ...
-
Python AWS Data Engineer
3 days ago
India Digitrix Software LLP Full timeExperience: 5 to 8 years Job description: Python AWS Data Engineer - Python, AWS Python (core language skill) -- Backend, Pandas, PySpark (DataFrame API), interacting with AWS (e.g., boto3 for S3, Glue, Lambda) - Data Processing: Spark (PySpark), Glue, EMR AWS Core Services: S3, Glue, Athena, Lambda, Step Functions, EMR - Containerization: Docker -...
-
Python AWS Data Engineer
4 days ago
India Digitrix Software LLP Full timeExperience : 5 to 8 years Job description: Python AWS Data Engineer Python, AWS Python (core language skill) -- Backend, Pandas, PySpark (DataFrame API), interacting with AWS (e.g., boto3 for S3, Glue, Lambda) Data Processing: Spark (PySpark), Glue, EMR AWS Core Services: S3, Glue, Athena, Lambda, Step Functions, EMR Containerization: Docker ...
-
AWS Architect Lead
2 weeks ago
Bengaluru, India NTT Data Full timeJob Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Architect Lead to join our team in Bangalore, Karntaka (IN-KA), India (IN). Job Title: Digital Engineering Sr...
