MSRcosmos - Senior Data Engineer - Azure Databricks

5 days ago


Hyderabad, Telangana, India MSR IT Services Full time

About the Role : We are seeking a highly experienced Senior Data Engineer with over 10 years of expertise in the big data domain. The ideal candidate will have strong proficiency in Azure Databricks, Spark Streaming, Python, PySpark, and SQL, along with a proven track record in designing and implementing robust data pipelines and data lake solutions. Key Responsibilities : Data Engineering & Development : - Develop and maintain scalable data pipelines using PySpark, Python, and Spark Streaming. - Implement ETL/ELT jobs for data ingestion and processing in data lakes. Databricks Expertise : - Utilize Databricks workspace, notebooks, job clusters, Delta Lake, Databricks Lakehouse, and Unity Catalog effectively. Big Data Management : - Design and implement data lake architectures and data warehouse solutions. - Work with SQL Server, NoSQL, Spark SQL for data modeling, query optimization, and parallel processing. Streaming Data Processing : - Integrate Kafka and Pub/Sub technologies for real-time data processing workflows. Agile Methodology : - Contribute to Agile development practices, including SCRUM methodologies and Application Lifecycle Management (ALM). Key Skills & Experience : - 10 years in IT within the big data domain, specializing in Hadoop, data lakes, and data engineering. - 3-4 years of hands-on experience with Databricks. - 5 years of strong development experience in PySpark and Python. - 6 years in designing and implementing data pipelines. - Proficient in Spark Streaming, SQL Server, NoSQL, Spark SQL, and data modeling. - Familiar with identity & access management, query optimization, and parallel processing. - Strong problem-solving skills with excellent communication abilities. - Knowledge of Agile development practices, SCRUM, and ALM. (ref:hirist.tech)



  • Hyderabad, Telangana, India MSRcosmos LLC Full time

    Job DescriptionWe are seeking a highly skilled Senior Azure Data Architect to join MSRcosmos LLC.Company OverviewAt MSRcosmos LLC, we pride ourselves on our innovative approach to data management and analytics. Our team is dedicated to providing cutting-edge solutions that drive business growth and success.Job DescriptionThe successful candidate will be...

  • Data Engineer

    3 days ago


    Hyderabad, Telangana, India MSRcosmos LLC Full time

    At MSRcosmos LLC, we're seeking a skilled Data Engineer with expertise in Databricks to join our team.Job OverviewWe're looking for an experienced professional to lead the design and implementation of data pipelines using Databricks, ensuring seamless data ingestion, processing, and storage.Key ResponsibilitiesDevelop and maintain scalable data pipelines...


  • Hyderabad, Telangana, India MSRcosmos LLC Full time

    At MSRcosmos LLC, we are on a mission to harness the power of data.Greetings from MSRcosmos!We are seeking a skilled Databricks Developer to join our team.About Us:MSRcosmos LLC is a cutting-edge organization that leverages advanced technologies to drive innovation. Our team works collaboratively to design and develop scalable solutions that meet complex...


  • Hyderabad, Telangana, India MSRcosmos LLC Full time

    Data Engineer PositionMSRcosmos LLC seeks an experienced Data Engineer to develop and maintain large-scale data systems. The ideal candidate will have a strong background in designing and implementing data pipelines and ETL/ELT jobs. They will collaborate with cross-functional teams to identify business requirements and design solutions. Key responsibilities...


  • Hyderabad, Telangana, India Innova ESI Full time

    About the Role : - We are seeking a highly skilled and experienced Senior Azure Databricks Engineer to join our dynamic data engineering team. - As a Senior Azure Databricks Engineer, you will play a critical role in designing, developing, and implementing data solutions on the Azure Databricks platform. - You will be responsible for building and maintaining...


  • Hyderabad, Telangana, India Innova ESI Full time

    About the Role : - We are seeking a highly skilled and experienced Senior Azure Databricks Engineer to join our dynamic data engineering team.- As a Senior Azure Databricks Engineer, you will play a critical role in designing, developing, and implementing data solutions on the Azure Databricks platform.- You will be responsible for building and maintaining...

  • Big Data Engineer

    2 days ago


    Hyderabad, Telangana, India MSRcosmos LLC Full time

    Job DescriptionWe are seeking an experienced Databricks developer to join MSRcosmos LLC. The ideal candidate will have a strong background in developing data pipelines and ETL/ELT jobs, as well as experience working with Spark Streaming and Kafka/Pub-Sub.Key Responsibilities:Design and develop data pipelines and ETL/ELT jobs to ingest and process data in a...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Role: Databricks DeveloperAbout the Job: We are seeking a highly skilled Databricks Developer to join our team at Tata Consultancy Services. The successful candidate will design and implement efficient data ingestion pipelines from multiple sources, ensuring high-quality and consistent data.Key Responsibilities:Designing and implementing end-to-end data...


  • Hyderabad, Telangana, India Tata Consultancy Services Full time

    Tata Consultancy Services is a global leader in digital transformation, and we are seeking an exceptional Azure Databricks Specialist to join our team. As a key member of our data engineering group, you will be responsible for designing, building, and maintaining large-scale data architectures on the Microsoft Azure platform.The ideal candidate will have a...

  • Darabricks developer

    3 weeks ago


    Hyderabad, Telangana, India MSRcosmos LLC Full time

    Greetings from MSRcosmos.. We are hiring for Databricks develoepr Experience: 2-5 Years Notice Period: Immediate joiners only Work location: Hyderabad Mode Of work: Work from Office Job Description: Minimum 3 year of experience in Databricks workspace, Databricks notebooks, Job cluster, Delta Lake, Databricks Lakehouse and Unity catalog Minimum 5 years'...


  • Hyderabad, Telangana, India MSRcosmos LLC Full time

    Greetings from MSRcosmos.. We are hiring for Databricks develoepr Experience: 3-7 Years Notice Period: Immediate joiners only Work location: Hyderabad Mode Of work: Work from Office Job Description: Minimum 3 year of experience in Databricks workspace, Databricks notebooks, Job cluster, Delta Lake, Databricks Lakehouse and Unity catalog Minimum 3 years'...


  • Hyderabad, Telangana, India Alignity Solutions Full time

    Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor Reviews If you are...

  • Senior Data Engineer

    3 weeks ago


    Hyderabad, Telangana, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Data Engineer with expertise in cloud technologies, Spark, and Databricks to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem.As a Senior Data...


  • Hyderabad, Telangana, India AIDEN AI PRIVATE LIMITED Full time

    Company OverviewAIDEN AI PRIVATE LIMITED is a leading company in the field of data engineering, specializing in data migration and cloud-based solutions. We are committed to delivering high-quality services to our clients and strive to be the go-to partner for all their data-related needs.Job SummaryWe are looking for a talented Azure Databricks Engineer to...


  • Hyderabad, Telangana, India IT & Services Full time

    Job Description : Data Engineer (Azure Databricks & PySpark)Position : Data EngineerExperience : 3 to 12 yearsPrimary Skills : Azure Databricks, PySpark, SQLSecondary Skills : ADF (Azure Data Factory)Location : Bengaluru/HyderabadMode of Work : HybridNotice Period : 0 to 30 DaysKey Responsibilities :ETL Development & Data Processing :- Design, develop, and...


  • Hyderabad, Telangana, India IT & Services Full time

    Job Description : Data Engineer (Azure Databricks & PySpark)Position : Data EngineerExperience : 3 to 12 yearsPrimary Skills : Azure Databricks, PySpark, SQLSecondary Skills : ADF (Azure Data Factory)Location : Bengaluru/HyderabadMode of Work : HybridNotice Period : 0 to 30 DaysKey Responsibilities :ETL Development & Data Processing :- Design, develop, and...


  • Hyderabad, Telangana, India MSR IT Services Full time

    **Role Overview:**We are seeking a seasoned Senior Data Engineer with over 10 years of expertise in big data domain to lead our data engineering efforts.The successful candidate will have a deep understanding of Azure Databricks, Spark Streaming, Python, PySpark, and SQL, and be able to design and implement robust data pipelines and data lake solutions.Key...


  • Hyderabad, Telangana, India MSRcosmos LLC Full time

    Title : Sr. Azure Databrick DeveloperOnly 12+Yrs experience profiles will be consideredKey skills required:Azure Databricks, Pyspark streaming, SQL, JSON data parsing.Roles/Responsibilities:Must have Azure Data factory, Azure Databricks, Azure Synapse and Azure environment exposure.Spark Structured Streaming :Must have experience in developing streaming...


  • Hyderabad, Telangana, India Alignity Solutions Full time

    Job Description Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor...

  • Darabricks developer

    3 weeks ago


    Hyderabad, Telangana, India MSRcosmos LLC Full time

    Greetings from MSRcosmos..We are hiring for Databricks develoeprExperience: 2-5 YearsNotice Period: Immediate joiners onlyWork location: HyderabadMode Of work: Work from OfficeJob Description:Minimum 3 year of experience in Databricks workspace, Databricks notebooks, Job cluster, Delta Lake, Databricks Lakehouse and Unity catalogMinimum 5 years' experience...