Databricks Data Engineer

6 days ago

tamil nadu, India Tata Consultancy Services Full time

About the RoleThe Databricks Data Engineer will play a crucial role in migrating and optimizing data workflows, ensuring high performance and reliability in our data operations.Experience- 3 to 6 yearsLocation - Kolkata /Chennai/TrivandrumRequired Technical Skill Set ------ Databricks, AWS, Python & PySparkGood to have- Experience in AWS platform (S3, EC2, EMR, MWAA, and Redshift).ResponsibilitiesCollaborate with stakeholders to gather requirements and design solutions using the Databricks platform.Migrate Python, Pyspark, MWAA DAG to Databricks Notebook and Workflow.Work with BJs Computer operations team and repoint Talend/MWAA Autosys jobs to Databricks workflow.Implement medallion architecture in Databricks Enterprise Data Platform with industry best practices and recommend the best framework for Redshift to Delta tables.Provide technical expertise and guidance to the team members and stakeholders.Contribute to the development of documentation, training materials, and user guides.Participate in testing and quality assurance activities to ensure reliability and performance.Optimize long-running Databricks workflows.Development experience in Python, Pyspark.Hands-on experience in writing complex SQLs and performance optimization of very complex SQL.

  • Databricks Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    About the RoleThe Databricks Data Engineer will play a crucial role in migrating and optimizing data workflows, ensuring high performance and reliability in our data operations.Experience- 3 to 6 yearsLocation - Kolkata /Chennai/TrivandrumRequired Technical Skill Set ------ Databricks, AWS, Python & PySparkGood to have- Experience in AWS platform (S3, EC2,...

  • Data Architect- Databricks

    5 days ago

    Chennai, Tamil Nadu, India InfoCepts Full time

    **Position**: Data Architect (Databricks, Snowflake) **Location**: Nagpur, Pune, Chennai, Bangalore **Type of Employment**:Full time Employment **Purpose of the Position**: Design and optimize cloud-native data architectures on platforms like Databricks and Snowflake, enabling scalable data engineering, advanced analytics, and AI/ML solutions aligned with...

  • Data Engineer – Databricks

    1 week ago

    tamil nadu, India Tata Consultancy Services Full time

    Role Summary: We are looking for a Data Engineer with expertise in Azure Databricks , data transformation , and integration pipelines to support forecasting, scheduling, and analytics flows in the WFM Re-Platform program. Key Responsibilities Design and implement data pipelines in Azure Databricks for ingesting and transforming data from upstream systems...

  • Azure Databricks Engineer

    2 weeks ago

    tamil nadu, India Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor) Required Technical Skill Set**Azure Databricks, Pyspark Experience: 4 to 10 Years Location: Hyd,Kolkata, Noida, Chennai, Bangalore Desired Competencies (Technical/Behavioral Competency) Must-Have** 1. Azure Data Bricks (Python) 2. Pyspark 3. ADLS 4. complex problem-solving skill Good-to-Have Azure Devops...

  • Databricks Admin

    6 days ago

    tamil nadu, India Tata Consultancy Services Full time

    Databricks AdminExp- 5 to 8 yearsLocation- Chennai/ KolkataRequired SkillsDatabricks AdministrationTerraformAWS cloud servicesMLflowWorkflowsDatabricks Asset BundlesAWS IAMVPCPrivate endpointsFirewallsS3SQL + PySparkdbx CLIResponsibilitiesImplement, and maintain the Databricks platform, including workspace setup, user and group management, access control,...

  • Azure Databricks Engineer

    2 weeks ago

    tamil nadu, India Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor)Required Technical Skill Set**Azure Databricks, PysparkExperience: 4 to 10 YearsLocation: Hyd,Kolkata, Noida, Chennai, BangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**1. Azure Data Bricks (Python)2. Pyspark3. ADLS4. complex problem-solving skillGood-to-HaveAzure DevopsAzure Data...

  • Principal Architect

    10 hours ago

    tamil nadu, India Tiger Analytics Full time

    Title : Principal Architect – Databricks Location : Chennai, Bengaluru, Hyderabad Who we areTiger Analytics is a global leader in AI and analytics, helping Fortune 1000 companies solve their toughest challenges. We offer full-stack AI and analytics services & solutions to empower businesses to achieve real outcomes and value at scale. We are on a mission...

  • Databricks

    7 days ago

    Coimbatore, Tamil Nadu, India Cognizant Full time

    **Description - External** **Skill: - Databricks** **Experience: 3 to 14 years** **Location: - Coimbatore (Walkin on 8th Feb)** **Must Have Skills** - Hands on experience with Azure Databricks, Azure Data Factory, Azure Analysis Services, Blob Storage, Databricks/Spark, Azure SQL DW/Synapse, and Azure functions. - In-depth knowledge of relational...

  • Data Engineer

    1 week ago

    tamil nadu, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks, Job Summary The Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business...

  • Data Engineer

    2 days ago

    tamil nadu, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks,Job SummaryThe Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements...