Databricks

6 days ago

Chennai Tamil Nadu, India Cognizant Full time

**Job Summary**

**Responsibilities**
- Develop and optimize data solutions using Databricks SQL to ensure efficient data processing and analysis.
- Implement and manage Databricks Workflows to automate data pipelines and improve operational efficiency.
- Collaborate with cross-functional teams to understand business requirements and translate them into technical solutions.
- Ensure data quality and integrity by implementing robust data validation and cleansing processes.
- Monitor and troubleshoot data workflows to identify and resolve issues promptly.
- Provide technical guidance and support to junior developers and team members.
- Stay updated with the latest industry trends and best practices in data engineering and analytics.
- Contribute to the continuous improvement of development processes and methodologies.
- Participate in code reviews to maintain high standards of code quality and performance.
- Document technical solutions and processes to ensure knowledge sharing and maintainability.
- Work closely with stakeholders to deliver data solutions that meet business needs and drive decision-making.
- Ensure compliance with data security and privacy regulations in all data processing activities.

**Qualifications**
- Possess strong expertise in Databricks SQL for efficient data processing and analysis.
- Have extensive experience with Databricks Workflows to automate and optimize data pipelines.
- Experience in the Payer domain is a plus providing valuable insights into industry-specific data challenges.
- Exhibit excellent problem-solving skills and the ability to troubleshoot complex data workflows.
- Show strong collaboration skills to work effectively with cross-functional teams and stakeholders.

**Certifications Required**

Databricks Certified Data Engineer Associate Apache Spark Developer Certification

  • Databrick

    7 days ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Key Responsibilities: Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...

  • Pyspark+databricks

    4 days ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Exp: 4 to 13 years** **Skill: Data Bricks+Pyspark** **Location : Bangalore/Hyderabad/Kolkota/Pune/Chennai** **Technical Skills**: Python,PySpark,Azure Data Lake Store,Databricks Workflows,Databricks SQL **Responsibilities**: - Develop and optimize data solutions using Azure Data Lake Store to support business needs. - Utilize Python to create...

  • Databricks + Pyspark

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Data Pipeline Development: Design, implement, and maintain scalable and efficient data pipelines using PySpark and Databricks for ETL processing of large volumes of data. Cloud Integration: Develop solutions leveraging Databricks on cloud platforms (AWS/Azure/GCP) to process and analyze data in a distributed computing environment. Data Modeling: Build robust...

  • Pyspark/databricks

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Bachelors degree or equivalent in Computer Engineering, Computer Science, or a related field. 5+ years of experience in data / software engineering role. 3+ years of experience with building AWS or Azure cloud-based data pipelines and AI solutions. 3+ years of experience with Python and Spark. Strong experience with Databricks, including Spark-based...

  • Pyspark & Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Bachelors degree or equivalent in Computer Engineering, Computer Science, or a related field. 7+ years of experience in data / software engineering role. 3+ years of experience with building AWS or Azure cloud-based data pipelines and AI solutions. 3+ years of experience with Python and Spark. Strong experience with Databricks, including Spark-based...

  • Databricks

    2 weeks ago

    Chennai, India Cognizant Technology Solutions Full time

    Job Summary Join our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will directly...

  • Databricks

    5 days ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job SummaryJoin our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will directly...

  • Azure Databricks Engineer

    10 hours ago

    tamil nadu, India Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor)Required Technical Skill Set**Azure Databricks, PysparkExperience: 4 to 10 YearsLocation: Hyd,Kolkata, Noida, Chennai, BangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**1. Azure Data Bricks (Python)2. Pyspark3. ADLS4. complex problem-solving skillGood-to-HaveAzure DevopsAzure Data...

  • Databricks with Aws(Datadog)

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Job Description: Were looking for an Engineer to support AWACs SRE tool migration initiative. Youll help configure and maintain new monitoring tools, replacing Datadog and LogicMonitor, and ensure visibility across AWS, Azure, and Databricks environments. Ideal for someone with hands on experience in observability and a passion for modern tooling. Key...

  • Azure Databricks Engineer

    2 hours ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    Role**Databricks Engineer (Individual Contributor)Required Technical Skill Set**Azure Databricks, PysparkExperience: 4 to 10 YearsLocation: Hyd,Kolkata, Noida, Chennai, BangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**1. Azure Data Bricks (Python)2. Pyspark3. ADLS4. complex problem-solving skillGood-to-HaveAzure DevopsAzure Data...