AWS Databricks Developer

1 day ago


Kolkata, West Bengal, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Role & responsibilities


• Develop and maintain scalable data pipelines using Apache Spark on Databricks.


• Build end-to-end ETL/ELT pipelines on AWS using services like S3, Glue, Lambda, EMR, and Step Functions.


• Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.


• Design and implement data models, schemas, and lakehouse architecture in Databricks.


• Optimize and tune Spark jobs for performance and cost-efficiency.


• Integrate data from multiple structured and unstructured data sources.


• Monitor and manage data workflows, ensuring data quality, consistency, and security.


• Follow best practices in CI/CD, code versioning (Git), and DevOps practices for data applications.


• Write clean, reusable, well-documented code using Python / PySpark / Scala.


• 4-8 years of total experience in data engineering or big data development.


• 23 years hands-on experience with Databricks and Apache Spark.


• Proficient in AWS cloud services (S3, Glue, Lambda, EMR, Redshift, CloudWatch, IAM).


• Strong programming skills in PySpark, Python, and optionally Scala.


• Solid understanding of data lakes, lakehouses, and Delta Lake concepts.


• Experience in SQL development and performance tuning.


• Familiarity with Airflow, dbt, or similar orchestration tools is a plus.


• Experience in CI/CD tools like Jenkins, GitHub Actions, or Code Pipeline.


• Knowledge of data security, governance, and compliance frameworks.



  • Kolkata, West Bengal, India beBeeDataArchitect Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data Information ArchitectJob Description:We are seeking an experienced Cloud Data Information Architect to join our team. As a Cloud Data Information Architect, you will be responsible for designing and implementing cloud data pipelines using AWS Databricks.Key Responsibilities:Identify and define foundational business data domains and...


  • Kolkata, West Bengal, India beBeeDeveloper Full time ₹ 1,04,000 - ₹ 1,30,878

    As a seasoned full-stack developer, we seek an individual with expertise in React and Java to spearhead the development of scalable and efficient applications on AWS.The ideal candidate will have hands-on experience with:- Building robust front-end interfaces using React- Designing and implementing microservices architecture- Integrating and deploying...


  • Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 28,00,000

    Azure Data Bricks Engineer PositionAs a highly skilled and experienced data engineer, you will play a key role in designing, developing, and maintaining robust data processing pipelines and analytics solutions using Databricks.This challenging position involves working closely with our architecture and engineering teams to architect scalable and efficient...

  • Cloud Data Architect

    2 weeks ago


    Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 14,00,000

    AWS Data Engineer JobWe are seeking a highly skilled Data Engineer to design and implement scalable data architectures on AWS.The ideal candidate will have a strong background in cloud-based data engineering, with a proven track record of designing, building, and maintaining scalable data pipelines using AWS services such as S3, Glue, and Redshift....


  • Kolkata, West Bengal, India beBeeDataArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data ArchitectWe are seeking a seasoned data architect to lead our organization's data strategy and infrastructure. As a key member of our team, you will be responsible for designing and implementing scalable data architectures that meet the evolving needs of our business.Design and implement Lakehouse architectures using Databricks, Delta...


  • Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Databricks EngineerAbout the Role:We are seeking an accomplished Data Engineer with a strong background in data engineering to help design, develop and maintain scalable high-performance data solutions on Databricks.The ideal candidate has hands-on experience in Databricks production environments, a deep understanding of modern data architecture,...


  • Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer PositionWe are seeking an experienced data engineer with strong skills in Databricks and SQL/Python to drive innovation in our team.About the Role:This is a senior-level position that requires hands-on experience in Teradata-to-Databricks migrations, ETL development, and large-scale data validation.Key Responsibilities:Convert Teradata...


  • Kolkata, West Bengal, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Data Engineer Position AvailableWe are seeking experienced professionals to assume the role of Senior Data Engineer. The ideal candidate will possess strong technical expertise and a minimum of 6 years of relevant experience in designing, developing, and maintaining large-scale data engineering solutions.Key Responsibilities:Design, develop, and...


  • Kolkata, West Bengal, India beBeeExpert Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Resilient Cloud Developer – AWS ExpertWe're seeking an experienced Resilient Cloud Developer with expertise in AWS to join our team.Job Description:Xebia is expanding its cloud and DevOps practice and looking for passionate developers with strong AWS skills to drive innovation, resilience, and automation at scale.Build & maintain resilient, fault-tolerant...


  • Kolkata, West Bengal, India Wipro Full time US$ 90,000 - US$ 1,20,000 per year

    Role PurposeThe purpose of this role is to prepare test cases and perform testing of the product/ platform/ solution to be deployed at a client end and ensure its meet 100% quality assurance parameters.Do*Instrumental in understanding the test requirements and test case design of the product*Authoring test planning with appropriate knowledge on business...