Sr. Data Engineer

5 days ago

Bengaluru, Karnataka, India Blue Cloud Softech Solutions Full time ₹ 24,00,000 - ₹ 30,00,000 per year

Job title-Data Engineer(Databricks with AWS & Python skills)

Mode:Remote

Location:Bengaluru

Primary Responsibilities

  • Design, develop, and maintain data lakes and data pipelines on AWS using ETL frameworks and Databricks.
  • Integrate and transform large-scale data from multiple heterogeneous sources into a centralized data lake environment.
  • Implement and manage Delta Lake architecture using Databricks Delta or Apache Hudi.
  • Develop end-to-end data workflows using PySpark, Databricks Notebooks, and Python scripts for ingestion, transformation, and enrichment.
  • Design and develop data warehouses and data marts for analytical workloads using Snowflake, Redshift, or similar systems.
  • Design and evaluate data models (Star, Snowflake, Flattened) for analytical and transactional systems.
  • Optimize data storage, query performance, and cost across the AWS and Databricks ecosystem.
  • Build and maintain CI/CD pipelines for Databricks notebooks, jobs, and Python-based data processing scripts.
  • Collaborate with data scientists, analysts, and stakeholders to deliver high-performance, reusable data assets.
  • Maintain and manage code repositories (Git) and promote best practices in version control, testing, and deployment.
  • Participate in making major technical and architectural decisions for data engineering initiatives.
  • Monitor and troubleshoot Databricks clusters, Spark jobs, and ETL processes for performance and reliability.
  • Coordinate with business and technical teams through all phases of the software development life cycle.

You Must Have

  • 5+ years of experience building and managing Data Lake Architecture on AWS Cloud
  • 3+ years of experience with AWS Data services such as S3, Glue, Lake Formation, EMR, Kinesis, RDS, DMS, and Redshift.
  • 3+ years of experience building Data Warehouses on Snowflake, Redshift, HANA, Teradata, or Exasol.
  • 3+ years of hands-on experience working with Apache Spark or PySpark, on Databricks.
  • 3+ years of experience implementing Delta Lakes using Databricks Delta or Apache Hudi.
  • 3+ years of experience in ETL development using Databricks, AWS Glue, or other modern frameworks.
  • Proficiency in Python for data engineering, automation, and API integrations.
  • Experience in Databricks Jobs, Workflows, and Cluster Management.
  • Experience with CI/CD pipelines and Infrastructure as Code (IaC) tools like Terraform or CloudFormation is a plus.
  • Bachelor's degree in computer science, Information Technology, Data Science, or related field.
  • Experience working on Agile projects and methodology in general.

We Value

  • Strong SQL, RDBMS, and data modeling skills.
  • Experience with Databricks Unity Catalog, Delta Live Tables (DLT), and MLflow for data governance and model lifecycle.
  • AWS or Databricks Cloud Certifications (e.g., AWS Data Analytics Specialty, Databricks Certified Data Engineer Professional) are a big plus.
  • Understanding data security, access control, and compliance in cloud environments.
  • Strong analytical, problem-solving, and communication skills.

Interested Candidates drop your updated resume at or whatsapp at

Job Type: Contractual / Temporary

Contract length: 14 months

Pay: ₹2,400, ₹3,000,000.00 per year

Benefits:

  • Provident Fund
  • Work from home

Experience:

  • Data Lake Architecture on AWS Cloud: 5 years (Required)
  • AWS Data services such as S3, Glue, Redshift.: 3 years (Required)
  • Data Warehouses on Snowflake, Redshift, HANA: 3 years (Required)
  • Apache Spark or PySpark, on Databricks.: 3 years (Required)
  • Delta Lakes using Databricks Delta or Apache Hudi.: 3 years (Required)
  • ETL development using Databricks, AWS Glue: 3 years (Required)

Work Location: Remote

  • Sr Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Req ID: 340286NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Data Engineer (Life and Annuity) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: At...

  • AWS Sr Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Sr Data Engineer to join our team in Bangalore or Remote, Karnātaka (IN-KA), India (IN). Position Location:OUS with...

  • Sr Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    At least 6+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution. Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must. Complete development, configuration, test cases and unit testing Perform code reviews and ensure standards...

  • Sr. Data Science

    1 week ago

    Bengaluru, Karnataka, India NTT DATA North America Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr. Data Science & AIML, GenAI Lead/Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).Job Duties: Job...

  • Sr. Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Nasdaq Full time ₹ 1,20,000 - ₹ 2,40,000 per year

    Nasdaq Technology is looking for a passionate Data Engineer with a focus on ETL pipelines, to join the Bangalore technology center in India. If Innovation and effectiveness drive you forward, this is the place for you Nasdaq is continuously revolutionizing markets and undergoing transformations while we adopt new technologies to develop innovative solutions,...

  • Search Engine Optimization Team Lead

    5 days ago

    Bengaluru, Karnataka, India SR WAVE Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Company DescriptionSR Wave is a leading technology partner specializing in a diverse range of innovative services, including UX/UI design, mobile app development, full-stack web development, and cloud computing. With expertise in AI, blockchain, IoT, VR/AR, and data analytics, we empower businesses with cutting-edge digital solutions. Our interdisciplinary...

  • Sr. Data Engineer

    1 week ago

    Bengaluru, Karnataka, India TCP Corps Full time ₹ 16,00,000 - ₹ 32,00,000 per year

    Job Description Job Role - Sr Data Engineer Location - Bangalore, Pune Salary - Up to 32 LPA Notice Period - Immediate joiners -15 days only. (Who can join form 20Jan ) Mandatory Key skills - AWS ,Data ware house, Integration , ETL,ML Key Responsibilities:Develop and implement portfolio Data modelling, assurance and utilization strategies and frameworks...

  • Data Entry Operator

    1 week ago

    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Sr. Data and Automation Engineer

    1 week ago

    Bengaluru, Karnataka, India Krazy Mantra HR Solutions Pvt. Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilled Sr. Data and Automation Engineer with 4 to 7 years of experience, located in Bangalore.Roles and ResponsibilityDesign and develop data automation solutions using Azure, ADF, ETL, Databricks, and Data Factory.Collaborate with cross-functional teams to identify and prioritize project requirements.Develop and maintain Power BI...

  • Data Engineer

    24 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    As a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...