Senior Data Engineer

4 days ago

Kottayam, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Job Title: Data Engineer for Oil and Gas

Location: Offshore/Remote

Experience: 5+ years

As a seasoned Data Engineer, you will design, build, and optimize scalable data pipelines and cloud solutions to support advanced analytics, reporting, and digital transformation initiatives in the oil and gas industry.

Key Responsibilities:

Data Engineering


• Design and develop scalable data pipelines using AWS cloud services.


• Ingest, process, and store structured/unstructured data from multiple sources (IoT devices, sensors, ERP systems, drilling logs, production data, etc.).


• Implement data lake and data warehouse solutions using AWS services such as S3, Redshift, Glue, Athena, EMR, and Lake Formation.


• Optimize data pipelines for performance, cost, and scalability.


• Collaborate with domain experts, data scientists, and business analysts to translate business requirements into data solutions.


• Ensure data governance, data quality, and security compliance.


• Support real-time data streaming and analytics using AWS services (Kinesis, Kafka, Lambda).


• Document technical solutions and provide knowledge transfer to the team.


• Proficiency in AWS services:

- S3, Redshift, Glue, Athena, EMR, Lake Formation

- Lambda, Kinesis, Step Functions, CloudWatch, RDS, DynamoDB (optional)


• Expertise in ETL/ELT development using PySpark, Python, or SQL.


• Experience with data modeling, warehousing, and performance tuning.


• Knowledge of data lake and modern data architecture.


• Strong SQL skills and ability to work with large datasets.


• Hands-on experience with CI/CD and DevOps practices for data solutions.


• Familiarity with oil and gas industry datasets and use cases (production, drilling, exploration, sensor/IoT data).


• Additional desirable skills include:

- Understanding of data ingestion patterns.

- Extensive knowledge of data bricks and Azure Data Factory.

- SQL knowledge.

- Incremental and append data load.

  • Senior Data Engineering Leader

    2 days ago

    Kottayam, Kerala, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering LeadershipAt our organization, we are seeking an experienced Data Engineer to lead a team of Senior Engineers. The successful candidate will be responsible for architecting and implementing workflow management systems, data warehouse design, and development.

  • Senior Data Engineer

    5 days ago

    Kottayam, Kerala, India Collabera Full time

    Senior Data EngineerArrangement: Fully RemoteShift: US Time Zone (Night Shift)Industry: Financial Institution (FI) - Credit UnionJob SummaryCollabera is seeking a seasoned Senior Data Engineer for its leading financial customer to design and optimize data solutions that power our analytics, reporting, and Member 360 initiatives. This role is ideal for...

  • Senior Cloud Data Engineer

    5 days ago

    Kottayam, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    We are looking for a highly skilled senior data engineer to design and develop scalable and high-performance data pipelines using Databricks and PySpark.Key Responsibilities:Develop, implement, and maintain complex data solutions on AWS using services such as S3, Glue, Lambda, EMR, and Redshift.Use automated deployment and testing tools for data workflows to...

  • # Senior Data Engineer Role

    4 days ago

    Kottayam, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data EngineerWe are seeking a Senior Data Engineer to join our team.Job Description:Design, develop and maintain large-scale data pipelines using PySpark.Key Responsibilities:Develop and implement scalable data pipelines using PySpark.Collaborate with cross-functional teams to integrate data engineering solutions.Ensure high-quality code and adhere to...

  • Master Data Engineering Specialist

    1 week ago

    Kottayam, Kerala, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Engineer Job DescriptionWe are seeking a seasoned data professional to lead our Global Intelligence Practice.The ideal candidate will have strong foundational skills in data warehousing and engineering, with exposure to various data architecture types.The successful candidate will work closely with client stakeholders to capture requirements,...

  • Senior Data Architect

    2 days ago

    Kottayam, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Unlock Your Potential as a Senior Data EngineerWe are seeking a highly skilled and experienced Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and developing robust ETL pipelines, architecting high-performance database structures, and developing BI dashboards.Our ideal candidate has...

  • Expert Data Engineering Leader

    4 days ago

    Kottayam, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    High-Quality Data Solutions Architect OpportunityJob Description:We are seeking an experienced Senior Data Engineer to design and implement cutting-edge data solutions. The ideal candidate will have 4–5 years of experience in data engineering, with expertise in PowerBI, Snowflake, Python, and complex SQL query writing.Key Responsibilities:Design and...

  • Freelance Senior Databricks Data Engineer

    4 weeks ago

    Kottayam, Kerala, India ThreatXIntel Full time

    Company DescriptionThreatXIntel is a startup cyber security company that specializes in protecting businesses and organizations from cyber threats. Our team offers services in cloud security, web and mobile security testing, cloud security assessment, and DevSecOps. We provide customized and affordable solutions to meet the specific needs of our clients,...

  • Senior Data Engineer

    6 days ago

    Kottayam, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    The Role:We are seeking an experienced Data Engineer to join our team.

  • Data Engineer

    1 week ago

    Kottayam, Kerala, India SourceFuse Full time

    SourceFuse Technologies hiring for Data Engineer with 3+ years for experience Job Summary:As a Data Engineer, you'll manage the invisible backbone of our analytics, building scalable data pipelines that fuel real-time insights for 630+ ships worldwide. Your work will turn raw data points into actionable intelligence, propelling machine learning models and...