Databricks

2 weeks ago

Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 1,04,000 - ₹ 1,30,878 per year

Job Summary

Join our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will directly impact our companys success and societal advancements.

Responsibilities

  • Develop and implement scalable data processing solutions using Spark in Scala to enhance data efficiency and performance.
  • Collaborate with cross-functional teams to design and optimize data workflows using Databricks Workflows and Databricks SQL.
  • Administer and manage Databricks Unity Catalog to ensure data governance and security across the organization.
  • Utilize Databricks CLI to automate data pipeline deployments and streamline operational processes.
  • Integrate and manage data storage solutions using Amazon S3 and Amazon Redshift to support data analytics initiatives.
  • Write and maintain high-quality Python and PySpark code to process and analyze large datasets effectively.
  • Implement Databricks Delta Lake for reliable and efficient data storage and retrieval.
  • Monitor and troubleshoot data workflows to ensure seamless data operations and minimize downtime.
  • Provide technical expertise and support to team members fostering a collaborative and innovative work environment.
  • Stay updated with the latest industry trends and technologies to continuously improve data solutions.
  • Contribute to the development of best practices and standards for data engineering processes.
  • Ensure data quality and integrity through rigorous testing and validation procedures.
  • Document and communicate technical solutions and processes to stakeholders for transparency and alignment.

Qualifications

  • Possess strong experience in Spark in Scala and Databricks technologies demonstrating proficiency in data engineering.
  • Have hands-on experience with Amazon S3 and Amazon Redshift for data storage and management.
  • Demonstrate expertise in Python and PySpark for data processing and analysis.
  • Experience with Databricks SQL and Delta Lake is essential for efficient data operations.
  • Familiarity with Databricks CLI and Unity Catalog Admin is highly desirable.
  • Strong problem-solving skills and ability to work in a hybrid work model.

  • Databricks Architect

    3 weeks ago

    Chennai, Tamil Nadu, India Datacrew Full time

    Job Title: Senior Databricks Data Engineer/Databricks ArchitectExperience: 5-8 yearsLocation: Chennai / Oman (Onsite)Note: Initial onsite for 3 months at Oman and back to Chennai to work from OffshoreEmployment Type: ContractRole Summary:The Databricks Architect will be responsible for designing, implementing, and optimizing scalable data architectures...

  • Databricks Developer

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 35,00,000

    Senior Data Engineer RoleWe are seeking a highly skilled Senior Data Engineer to join our team. As a key contributor, you will be responsible for designing, developing, and deploying scalable data pipelines and ETL processes using Databricks.Key ResponsibilitiesDesign and develop efficient data pipelines and workflows in Databricks.Optimize Spark jobs to...

  • Databricks Audit Expert

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeDatabricks Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job Opportunity: Databricks Audit ExpertThe ideal candidate will have expertise in assessing and implementing Databricks on Azure, as well as a deep understanding of infrastructure deployments and scalability.Audit and assess the current Databricks implementation on Azure and integration with AzureDevOps to identify areas for improvement and...

  • Databricks With Data Analyst

    2 weeks ago

    Chennai, Tamil Nadu, India virtusa Full time

    Role Summary We are seeking skilled Data Analysts to support Informatica MDM production operations including data ingestion from Databricks stewardship console support and downstream data consumption The role involves monitoring troubleshooting and collaborating with business and engineering teams to ensure data quality and operational continuity Key...

  • Azure Databricks Administrator

    2 weeks ago

    Chennai, Tamil Nadu, India Randomtrees Full time ₹ 1,50,000 - ₹ 28,00,000 per year

    Roles and ResponsibilitiesDesign, implement, and maintain Azure Databricks clusters for data engineering workloads.Configure and manage Azure DevOps pipelines for CI/CD processes using Python scripts.Migrate on-premises databases to Azure platforms using Data Bricks migration tools.Troubleshoot issues related to Azure Databricks cluster performance,...

  • Data Engineer- Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India InfoCepts Full time ₹ 4,00,000 - ₹ 8,00,000 per year

    Position: Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:Work with business analysts and data architects to translate requirements into technical implementations.Design, develop, implement, and maintain pyspark code...

  • Senior Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeDataengineer Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Title: Databricks LeadWe are seeking a seasoned Data Engineer with expertise in developing and implementing ETL pipelines using Databricks on cloud AWS.Key Responsibilities:Design, implement, and manage data analytics using Databricks.Develop data pipelines using Python, PySpark, and SQL.Collaborate with cross-functional teams to deliver projects on...

  • Data Architect- Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India InfoCepts Full time ₹ 6,00,000 - ₹ 8,00,000 per year

    Position: Data Architect (Databricks, Snowflake)Location: Nagpur, Pune, Chennai, BangaloreType of Employment: Full time EmploymentPurpose of the Position:Design and optimize cloud-native data architectures on platforms like Databricks and Snowflake, enabling scalable data engineering, advanced analytics, and AI/ML solutions aligned with business needs.Key...

  • Azure Databricks Solutions Lead

    1 week ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Senior Data ArchitectWe are seeking an experienced Senior Data Architect to lead the design and implementation of scalable data processing solutions using Azure Databricks.Maintain large-scale data pipelines to ingest data from diverse sources, ensuring seamless integration and efficient data retrieval processes.Collaborate with cross-functional teams to...

  • Azure Databricks Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Capgemini Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and...