MSRcosmos - Senior Data Engineer - Azure Databricks

2 weeks ago


Hyderabad, Telangana, India MSR IT Services Full time

About the Role :

We are seeking a highly experienced Senior Data Engineer with over 10 years of expertise in the big data domain. The ideal candidate will have strong proficiency in Azure Databricks, Spark Streaming, Python, PySpark, and SQL, along with a proven track record in designing and implementing robust data pipelines and data lake solutions.

Key Responsibilities :

Data Engineering & Development :

- Develop and maintain scalable data pipelines using PySpark, Python, and Spark Streaming.

- Implement ETL/ELT jobs for data ingestion and processing in data lakes.

Databricks Expertise :

- Utilize Databricks workspace, notebooks, job clusters, Delta Lake, Databricks Lakehouse, and Unity Catalog effectively.

Big Data Management :

- Design and implement data lake architectures and data warehouse solutions.

- Work with SQL Server, NoSQL, Spark SQL for data modeling, query optimization, and parallel processing.

Streaming Data Processing :

- Integrate Kafka and Pub/Sub technologies for real-time data processing workflows.

Agile Methodology :

- Contribute to Agile development practices, including SCRUM methodologies and Application Lifecycle Management (ALM).

Key Skills & Experience :

- 10+ years in IT within the big data domain, specializing in Hadoop, data lakes, and data engineering.

- 3-4+ years of hands-on experience with Databricks.

- 5+ years of strong development experience in PySpark and Python.

- 6+ years in designing and implementing data pipelines.

- Proficient in Spark Streaming, SQL Server, NoSQL, Spark SQL, and data modeling.

- Familiar with identity & access management, query optimization, and parallel processing.

- Strong problem-solving skills with excellent communication abilities.

- Knowledge of Agile development practices, SCRUM, and ALM.

(ref:hirist.tech)

  • Hyderabad, Telangana, India MSRcosmos LLC Full time

    Welcome to MSRcosmos LLC, where we're passionate about innovation and technology. We're seeking a seasoned professional to join our team as a Databricks Developer.About the RoleThis is an exciting opportunity for an experienced professional to take on new challenges and contribute to the growth of our organization. As a Databricks Developer, you will be...

  • Big Data Engineer

    6 days ago


    Hyderabad, Telangana, India MSRcosmos LLC Full time

    Greetings from MSRcosmos LLC. We are a dynamic organization seeking an experienced professional to fill the role of Databricks Developer.Job DescriptionWe require a highly skilled individual with a minimum of 3 years' experience in Databricks workspace, Databricks notebooks, Job cluster, Delta Lake, Databricks Lakehouse and Unity catalog.The ideal candidate...


  • Hyderabad, Telangana, India Innova ESI Full time

    About the Role : - We are seeking a highly skilled and experienced Senior Azure Databricks Engineer to join our dynamic data engineering team.- As a Senior Azure Databricks Engineer, you will play a critical role in designing, developing, and implementing data solutions on the Azure Databricks platform.- You will be responsible for building and maintaining...


  • Hyderabad, Telangana, India Innova ESI Full time

    About the Role : - We are seeking a highly skilled and experienced Senior Azure Databricks Engineer to join our dynamic data engineering team.- As a Senior Azure Databricks Engineer, you will play a critical role in designing, developing, and implementing data solutions on the Azure Databricks platform.- You will be responsible for building and maintaining...


  • Hyderabad, Telangana, India MSRcosmos LLC Full time

    We are MSRcosmos LLC, a forward-thinking organization dedicated to leveraging cutting-edge technology to drive business growth. We're currently seeking a highly skilled Databricks Developer to join our team.Job ResponsibilitiesAs a Databricks Developer, you will play a critical role in designing, building, and maintaining complex data pipelines using...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Company Overview: Tata Consultancy Services is a global leader in IT services and consulting. Our team of experts provides innovative solutions to clients across various industries.As an Azure Databricks Engineer, you will play a crucial role in designing, developing, and maintaining large-scale data pipelines using Azure Databricks and Spark. Your expertise...

  • Darabricks developer

    2 weeks ago


    Hyderabad, Telangana, India MSRcosmos LLC Full time

    Greetings from MSRcosmos.. We are hiring for Databricks develoepr Experience: 2-5 Years Notice Period: Immediate joiners only Work location: Hyderabad Mode Of work: Work from Office Job Description: Minimum 3 year of experience in Databricks workspace, Databricks notebooks, Job cluster, Delta Lake, Databricks Lakehouse and Unity catalog Minimum 5 years'...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Position:Azure Databricks EngineerExperience: 6-8 yearsLocation: New Delhi, HyderabadJob Description:Required Technical Skill Set** Azure DatabricksDesired Competencies (Technical/Behavioral Competency)Must-Have**• Qualifications:· 2-5 years of relevant IT experience with good exposure to Cloud technologies.· Experience using Databricks and proficiency...


  • Hyderabad, Telangana, India Alignity Solutions Full time

    Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor Reviews If you are...

  • Senior Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Data Engineer with expertise in cloud technologies, Spark, and Databricks to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem.As a Senior Data...

  • Darabricks developer

    2 weeks ago


    Hyderabad, Telangana, India MSRcosmos LLC Full time

    Greetings from MSRcosmos..We are hiring for Databricks develoeprExperience: 2-5 YearsNotice Period: Immediate joiners onlyWork location: HyderabadMode Of work: Work from OfficeJob Description:Minimum 3 year of experience in Databricks workspace, Databricks notebooks, Job cluster, Delta Lake, Databricks Lakehouse and Unity catalogMinimum 5 years' experience...

  • Darabricks developer

    2 weeks ago


    Hyderabad, Telangana, India MSRcosmos LLC Full time

    Greetings from MSRcosmos..We are hiring for Databricks develoeprExperience: 3-7 YearsNotice Period: Immediate joiners onlyWork location: HyderabadMode Of work: Work from OfficeJob Description:- Minimum 3 year of experience in Databricks workspace, Databricks notebooks, Job cluster, Delta Lake, Databricks Lakehouse and Unity catalog- Minimum 3 years'...

  • Darabricks developer

    2 weeks ago


    Hyderabad, Telangana, India MSRcosmos LLC Full time

    Greetings from MSRcosmos..We are hiring for Databricks develoeprExperience: 3-7 YearsNotice Period: Immediate joiners onlyWork location: HyderabadMode Of work: Work from OfficeJob Description:- Minimum 3 year of experience in Databricks workspace, Databricks notebooks, Job cluster, Delta Lake, Databricks Lakehouse and Unity catalog- Minimum 3 years'...


  • Hyderabad, Telangana, India IT & Services Full time

    Job Description : Data Engineer (Azure Databricks & PySpark)Position : Data EngineerExperience : 3 to 12 yearsPrimary Skills : Azure Databricks, PySpark, SQLSecondary Skills : ADF (Azure Data Factory)Location : Bengaluru/HyderabadMode of Work : HybridNotice Period : 0 to 30 DaysKey Responsibilities :ETL Development & Data Processing :- Design, develop, and...


  • Hyderabad, Telangana, India IT & Services Full time

    Job Description : Data Engineer (Azure Databricks & PySpark)Position : Data EngineerExperience : 3 to 12 yearsPrimary Skills : Azure Databricks, PySpark, SQLSecondary Skills : ADF (Azure Data Factory)Location : Bengaluru/HyderabadMode of Work : HybridNotice Period : 0 to 30 DaysKey Responsibilities :ETL Development & Data Processing :- Design, develop, and...


  • Hyderabad, Telangana, India Alignity Solutions Full time

    Job Description Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor...

  • Sr. Azure Developer

    1 week ago


    Hyderabad, Telangana, India MSRcosmos LLC Full time

    Title : Sr. Azure Databrick DeveloperOnly 12+Yrs experience profiles will be consideredKey skills required: Azure Databricks, Pyspark streaming, SQL, JSON data parsing.Roles/Responsibilities:Must have Azure Data factory, Azure Databricks, Azure Synapse and Azure environment exposure.Spark Structured Streaming :Must have experience in developing streaming...

  • Darabricks developer

    2 weeks ago


    Hyderabad, Telangana, India MSRcosmos LLC Full time

    Greetings from MSRcosmos..We are hiring for Databricks develoeprExperience: 2-5 YearsNotice Period: Immediate joiners onlyWork location: HyderabadMode Of work: Work from OfficeJob Description:Minimum 3 year of experience in Databricks workspace, Databricks notebooks, Job cluster, Delta Lake, Databricks Lakehouse and Unity catalogMinimum 5 years' experience...

  • Darabricks developer

    2 weeks ago


    Hyderabad, Telangana, India MSRcosmos LLC Full time

    Greetings from MSRcosmos..We are hiring for Databricks develoeprExperience: 2-5 YearsNotice Period: Immediate joiners onlyWork location: HyderabadMode Of work: Work from OfficeJob Description:Minimum 3 year of experience in Databricks workspace, Databricks notebooks, Job cluster, Delta Lake, Databricks Lakehouse and Unity catalogMinimum 5 years' experience...


  • Hyderabad, Telangana, India Leuwint Technologies Full time

    Job Description :- Minimum 4 years of experience in relevant field.- Hands on experience in Databricks, SQL, Azure Data Factory, Azure DevOps- Strong expertise in Microsoft Azure cloud platform services (Azure Data Factory, Azure Data Bricks, Azure SQL Database, Azure Data Lake Storage, Azure Synapse Analytics).- Proficient in CI-CD pipelines in Azure DevOps...