Databricks Data Engineer

6 days ago

tamil nadu, India Tata Consultancy Services Full time

About the Role The Databricks Data Engineer will play a crucial role in migrating and optimizing data workflows, ensuring high performance and reliability in our data operations. Experience- 3 to 6 years Location - Kolkata /Chennai/Trivandrum Required Technical Skill Set ------ Databricks, AWS, Python & PySpark Good to have- Experience in AWS platform (S3, EC2, EMR, MWAA, and Redshift). Responsibilities Collaborate with stakeholders to gather requirements and design solutions using the Databricks platform. Migrate Python, Pyspark, MWAA DAG to Databricks Notebook and Workflow. Work with BJs Computer operations team and repoint Talend/MWAA Autosys jobs to Databricks workflow. Implement medallion architecture in Databricks Enterprise Data Platform with industry best practices and recommend the best framework for Redshift to Delta tables. Provide technical expertise and guidance to the team members and stakeholders. Contribute to the development of documentation, training materials, and user guides. Participate in testing and quality assurance activities to ensure reliability and performance. Optimize long-running Databricks workflows. Development experience in Python, Pyspark. Hands-on experience in writing complex SQLs and performance optimization of very complex SQL.

  • Databricks Data Engineer

    2 days ago

    tamil nadu, India Tata Consultancy Services Full time

    About the RoleThe Databricks Data Engineer will play a crucial role in migrating and optimizing data workflows, ensuring high performance and reliability in our data operations.Experience- 3 to 6 yearsLocation - Kolkata /Chennai/TrivandrumRequired Technical Skill Set ------ Databricks, AWS, Python & PySparkGood to have- Experience in AWS platform (S3, EC2,...

  • Databricks Engineer

    1 week ago

    tamil nadu, India Tata Consultancy Services Full time

    TCS present an excellent opportunity for Databricks Engineer Job Location: Chennai (ONLY) Experience required : 6-10 yrs Virtual Interview Date: 25-Oct-25 (Saturday) Must-Have Data Engineer having , Databricks & AWS development experience Development experience in Python, Pyspark Hands-on experience in writing complex SQLs and performance optimization of...

  • Databricks Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    About the RoleThe Databricks Data Engineer will play a crucial role in migrating and optimizing data workflows, ensuring high performance and reliability in our data operations.Experience- 3 to 6 yearsLocation - Kolkata /Chennai/TrivandrumRequired Technical Skill Set ------ Databricks, AWS, Python & PySparkGood to have- Experience in AWS platform (S3, EC2,...

  • Data Architect- Databricks

    3 days ago

    Chennai, Tamil Nadu, India InfoCepts Full time

    **Position**: Data Architect (Databricks, Snowflake) **Purpose of the Position**: Design and optimize cloud-native data architectures on platforms like Databricks and Snowflake, enabling scalable data engineering, advanced analytics, and AI/ML solutions aligned with business needs. **Location**: Nagpur, Pune, Chennai, Bangalore **Type of Employment**:Full...

  • Databricks Engineer

    2 weeks ago

    tamil nadu, India Tata Consultancy Services Full time

    TCS present an excellent opportunity for Databricks EngineerJob Location: Chennai (ONLY)Experience required : 6-10 yrsVirtual Interview Date: 25-Oct-25 (Saturday)Must-HaveData Engineer having , Databricks & AWS development experienceDevelopment experience in Python, Pyspark Hands-on experience in writing complex SQLs and performance optimization of very...

  • Azure Databricks Engineer

    1 week ago

    tamil nadu, India Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor)Required Technical Skill Set**Azure Databricks, PysparkExperience: 4 to 10 YearsLocation: Hyd,Kolkata, Noida, Chennai, BangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**1. Azure Data Bricks (Python)2. Pyspark3. ADLS4. complex problem-solving skillGood-to-HaveAzure DevopsAzure Data...

  • Azure Databricks Engineer

    1 week ago

    tamil nadu, India Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor) Required Technical Skill Set**Azure Databricks, Pyspark Experience: 4 to 10 Years Location: Hyd,Kolkata, Noida, Chennai, Bangalore Desired Competencies (Technical/Behavioral Competency) Must-Have** 1. Azure Data Bricks (Python) 2. Pyspark 3. ADLS 4. complex problem-solving skill Good-to-Have Azure Devops...

  • Databricks

    1 week ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Job Summary** **Responsibilities** - Develop and optimize data solutions using Databricks SQL to ensure efficient data processing and analysis. - Implement and manage Databricks Workflows to automate data pipelines and improve operational efficiency. - Collaborate with cross-functional teams to understand business requirements and translate them into...

  • Databricks Admin

    2 weeks ago

    tamil nadu, India Tata Consultancy Services Full time

    Databricks Admin Exp- 5 to 8 years Location- Chennai/ Kolkata Required Skills Databricks Administration Terraform AWS cloud services MLflow Workflows Databricks Asset Bundles AWS IAM VPC Private endpoints Firewalls S3 SQL + PySpark dbx CLI Responsibilities Implement, and maintain the Databricks platform, including workspace setup, user and group management,...

  • Databricks Admin

    2 days ago

    tamil nadu, India Tata Consultancy Services Full time

    Databricks AdminExp- 5 to 8 yearsLocation- Chennai/ KolkataRequired SkillsDatabricks AdministrationTerraformAWS cloud servicesMLflowWorkflowsDatabricks Asset BundlesAWS IAMVPCPrivate endpointsFirewallsS3SQL + PySparkdbx CLIResponsibilitiesImplement, and maintain the Databricks platform, including workspace setup, user and group management, access control,...