Senior Data Architect

3 days ago

Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 18,00,000
Data Engineer in Oil and Gas Industry

We are seeking an experienced Data Engineer to design, build, and optimize scalable data pipelines and cloud solutions for the Oil and Gas industry.

The ideal candidate will have strong experience in AWS cloud services, data engineering, and knowledge of Oil and Gas upstream, midstream or downstream processes to support advanced analytics, reporting, and digital transformation initiatives.

Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines and ETL/ELT solutions using AWS cloud services.
  • Ingest, process, and store structured/unstructured data from multiple sources.
  • Implement data lake and data warehouse solutions.
  • Optimize data pipelines for performance, cost, and scalability.
  • Collaborate with domain experts, data scientists, and business analysts to translate business requirements into data solutions.
  • Ensure data governance, data quality, and security compliance.
  • Support real-time data streaming and analytics using AWS services.
  • Document technical solutions and provide knowledge transfer to the team.
Required Skills:
  • Proficiency in AWS services: S3, Redshift, Glue, Athena, EMR, Lake Formation, Lambda, Kinesis, Step Functions, CloudWatch, RDS, DynamoDB.
  • Expertise in ETL/ELT development using PySpark, Python, or SQL.
  • Experience with data modeling, warehousing, and performance tuning.
  • Knowledge of data lake and modern data architecture.
  • Strong SQL skills and ability to work with large datasets.
  • Familiarity with CI/CD and DevOps practices for data solutions.
  • Familiarity with Oil and Gas industry datasets and use cases.

Candidate will also be judged on following skills:

  • Understanding of data ingestion pattern.
  • Extensive knowledge of data bricks & Azure Data Factory.
  • SQL Knowledge.
  • Incremental & Append data load.

  • Senior Data Architect

    5 days ago

    Madurai, Tamil Nadu, India beBeeData Full time US$ 1,00,000 - US$ 2,00,000

    About Data ArchitectsData architects play a pivotal role in designing and implementing data management systems, ensuring seamless integration with business operations.

  • Senior Data Architect

    6 days ago

    Madurai, Tamil Nadu, India beBeeDataIntegration Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Informatica DeveloperJob OverviewWe are seeking a highly skilled and experienced Informatica IDMC ETL developer to join our team. As an ideal candidate, you will have a deep understanding of ETL design, data pipeline development, and Informatica Cloud Data Integration (CDI). You will be responsible for designing, developing, testing, and...

  • Chief Data Architect

    4 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineer PositionWe are seeking an experienced Senior Data Engineer to lead the design, development, and maintenance of our modern data platform.Data Engineering: Design and implement efficient, scalable ETL/ELT pipelines and data flows.Transformation Models: Develop transformation models using dbt and orchestrate pipelines via Airflow.Processing...

  • Senior Data Architect

    1 week ago

    Madurai, Tamil Nadu, India beBeeData Full time US$ 1,20,000 - US$ 1,50,000

    We're seeking a seasoned Data Engineer to spearhead our clients' data modernization endeavors. As a key member of our team, you'll work closely with 70+ engineers to guide and assist clients in their data transformation journeys.Our team collaborates with companies driving innovation and creating new products in uncharted markets. We bring senior engineers,...

  • Cloud Data Architect

    4 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Cloud Data ArchitectAs a Cloud Data Architect, you will design and develop cutting-edge technology that combines Large Language Models (LLMs), Agents, Knowledge Graph, and vector search in the cloud to revolutionize financial data analysis.Design scalable systems that can handle large-scale document processing during due diligence.Develop sophisticated...

  • Financial Data Platform Architect

    3 days ago

    Madurai, Tamil Nadu, India beBeeEngineer Full time US$ 1,25,000 - US$ 1,75,000

    Join us in our mission to revolutionize the financial system. At Coinbase, we are pushing the boundaries of what is possible with blockchain technology and creating a platform for the future global financial system.About the RoleWe are seeking a talented software engineer to join our team as an architect and developer of our financial data platform. This is...

  • Senior Data Solutions Architect

    3 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,10,00,000

    Job OverviewWe are seeking a seasoned data engineer to spearhead the development of cutting-edge data solutions. The ideal candidate will possess expertise in designing and implementing complex data pipelines, as well as collaborating with cross-functional teams to drive business growth.About the Role:Craft modern data warehouse solutions leveraging...

  • Senior Data Architect

    5 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Lead Data Engineer Job DescriptionWe are seeking a highly skilled Lead Data Engineer to join our team. As a Lead Data Engineer, you will be responsible for designing, developing, and optimizing data pipelines using Azure and Databricks.This is a senior technical role with high expectations. The consultant must be extremely hands-on, technically strong in...

  • Senior Enterprise Data Architect

    3 days ago

    Madurai, Tamil Nadu, India beBeeArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data ArchitectDesign and implement a robust data warehousing platform for the pharmaceutical industry.Key Responsibilities:Data Modeling: Develop logical and physical data models to ensure efficient data storage and retrieval.ETL Processes: Design, develop, and optimize ETL processes to accurately and efficiently move data from various sources into the data...

  • Data Ecosystem Architect

    4 days ago

    Madurai, Tamil Nadu, India beBeeDataArchitecture Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the RoleWe are seeking a skilled Data Architect to develop and implement our end-to-end data architecture strategy, ensuring our data foundation supports business growth and innovation.The ideal candidate will be responsible for designing and building scalable and secure enterprise data architecture, including data lakes, warehouses, and real-time...