Data Engineering Expert

7 days ago

Shimoga, Karnataka, India beBeeEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Title: Data Engineering Expert

We are seeking a seasoned Data Engineering professional with expertise in designing, developing, and optimizing data ingestion pipelines for integrating multiple sources into Databricks.

  • Design and implement scalable data ingestion architectures using Databricks, Spark, and data lake technologies.
  • Develop and maintain CI/CD pipelines for data workflows, leveraging tools such as GitHub Actions, Jenkins, or Azure DevOps.
  • Deploy and manage containerized applications using Kubernetes, ensuring high availability and performance.
  • Evaluate and optimize data integrity, security, and compliance throughout the ingestion process.
  • Collaborate with cross-functional teams to streamline data ingestion strategies and improve overall efficiency.
  • Troubleshoot and resolve complex ingestion pipeline issues for optimal performance and scalability.
Key Requirements:
  • Proven experience in data engineering, including design, development, and optimization of data pipelines.
  • Hands-on experience with CI/CD tools and cloud platforms, including AWS, Azure, or GCP.
  • Strong knowledge of Kubernetes, container orchestration, and microservices architecture.
  • Proficiency in programming languages such as Python, Scala, or SQL for data processing.
  • Familiarity with cloud storage solutions and big data technologies.
  • Strong problem-solving and analytical skills, with ability to work independently and collaboratively.
Preferred Qualifications:
  • Experience with infrastructure as code (Terraform, Helm, etc.) and continuous integration.
  • Background in streaming data ingestion (Kafka, Kinesis, etc.) and real-time data processing.
  • Knowledge of data governance and security best practices, including compliance regulations.

  • Data Engineer – Cloud Expert

    4 days ago

    Shimoga, Karnataka, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 21,00,000

    Job Title: Data Engineer - Cloud ExpertWe are seeking a skilled Data Engineer to join our team as a Freelance Cloud Expert. This is an exciting opportunity for a talented professional with expertise in cloud-based data engineering to contribute to the design, development, and optimization of large-scale data pipelines.This role involves working closely with...

  • Data Engineering Visionary

    12 hours ago

    Shimoga, Karnataka, India beBeeDataEngineering Full time ₹ 70,00,000 - ₹ 1,25,00,000

    Senior Data Engineering ExpertAs a senior data engineering expert, you will play a pivotal role in designing and developing cutting-edge data pipelines using industry-leading tools such as Oracle Data Flow and Apache Spark (PySpark). With a deep understanding of complex data patterns, Python, and SQL, you will drive innovation and growth within our...

  • Senior Data Engineering Expert

    13 hours ago

    Shimoga, Karnataka, India beBeeDataEngineering Full time US$ 1,80,000 - US$ 2,10,000

    Key Role in Healthcare IndustryWe are seeking a seasoned Senior Data Engineering Expert to lead our data architecture and pipeline development. This is an exciting opportunity for an innovative professional to design, develop, and govern our data infrastructure.Responsibilities:Data Architecture Design: Develop scalable and robust data architectures for data...

  • Data Center Cooling Expert

    5 days ago

    Shimoga, Karnataka, India beBeeCooling Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Data Center Cooling ExpertWe are seeking an experienced Data Center Cooling Expert to lead the design and implementation of cutting-edge cooling solutions for hyperscale data centers. With a strong background in thermal management, HVAC systems, and energy-efficient technologies, you will be responsible for ensuring our data centers achieve optimal...

  • Aws Sr. Engineer

    4 days ago

    Shimoga, Karnataka, India NTT DATA Full time

    Req ID 304645NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a AWS Sr Engineer to join our team in Remote Karnxc4x81taka IN-KA India IN Basic Qualifications 3 years ...

  • Data Migration Expert

    7 days ago

    Shimoga, Karnataka, India beBeeMigration Full time ₹ 13,00,000 - ₹ 19,00,000

    We are seeking a skilled professional to join our team as a Data Migration Expert. This role involves the design, management, and optimization of complex data migrations.The ideal candidate will have experience in conducting customer migrations, with a strong understanding of ETL/ELT processes using dbt, AWS, and Redshift. They will also be proficient in...

  • Data Engineering Leader

    7 days ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Lead Data Engineering ExpertWe are seeking an accomplished data engineering professional to spearhead our company's data initiatives.As a senior member of the team, you will be responsible for leading and mentoring junior engineers in developing, implementing, and maintaining large-scale ETL pipelines. You will utilize industry-leading tools such as...

  • Expert in Data Management

    2 days ago

    Shimoga, Karnataka, India beBeeDataManagement Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    Job Title: Data Management ExpertAbout the RoleElevarae seeks an experienced professional to lead our data management initiatives. As a seasoned Data Management Expert, you will spearhead the development and maintenance of cutting-edge data management modules.This role involves driving design, development, and deployment of data management and storage...

  • Senior Data Engineering Professional

    2 days ago

    Shimoga, Karnataka, India beBeeDataEngineering Full time US$ 1,20,000 - US$ 1,70,000

    Job Title: Data Engineering SpecialistPurpose:We are seeking a seasoned Data Engineering specialist to collaborate with our team of software, data, and DevOps engineers in guiding clients' data modernization journey.Our team works with innovative companies creating new products in emerging markets. We bring experienced senior engineers, cutting-edge...

  • Expert Data Migration Professional

    5 days ago

    Shimoga, Karnataka, India beBeeDataMigration Full time ₹ 15,00,000 - ₹ 20,00,000

    Key Role:Senior Data Migration ExpertJob SummaryThe Senior Data Migration Expert will be responsible for leading the end-to-end execution of data migration activities. This includes developing a comprehensive data migration strategy, collaborating with stakeholders to define data requirements and mapping rules, and managing the migration of master data,...