MSRcosmos - Senior Data Engineer - Azure Databricks
1 week ago
About the Role :
We are seeking a highly experienced Senior Data Engineer with over 10 years of expertise in the big data domain. The ideal candidate will have strong proficiency in Azure Databricks, Spark Streaming, Python, PySpark, and SQL, along with a proven track record in designing and implementing robust data pipelines and data lake solutions.
Key Responsibilities :
Data Engineering & Development :
- Develop and maintain scalable data pipelines using PySpark, Python, and Spark Streaming.
- Implement ETL/ELT jobs for data ingestion and processing in data lakes.
Databricks Expertise :
- Utilize Databricks workspace, notebooks, job clusters, Delta Lake, Databricks Lakehouse, and Unity Catalog effectively.
Big Data Management :
- Design and implement data lake architectures and data warehouse solutions.
- Work with SQL Server, NoSQL, Spark SQL for data modeling, query optimization, and parallel processing.
Streaming Data Processing :
- Integrate Kafka and Pub/Sub technologies for real-time data processing workflows.
Agile Methodology :
- Contribute to Agile development practices, including SCRUM methodologies and Application Lifecycle Management (ALM).
Key Skills & Experience :
- 10+ years in IT within the big data domain, specializing in Hadoop, data lakes, and data engineering.
- 3-4+ years of hands-on experience with Databricks.
- 5+ years of strong development experience in PySpark and Python.
- 6+ years in designing and implementing data pipelines.
- Proficient in Spark Streaming, SQL Server, NoSQL, Spark SQL, and data modeling.
- Familiar with identity & access management, query optimization, and parallel processing.
- Strong problem-solving skills with excellent communication abilities.
- Knowledge of Agile development practices, SCRUM, and ALM.
-
Databricks Solutions Architect
6 days ago
Hyderabad, Telangana, India MSRcosmos LLC Full timeWelcome to MSRcosmos LLC, where we're passionate about innovation and technology. We're seeking a seasoned professional to join our team as a Databricks Developer.About the RoleThis is an exciting opportunity for an experienced professional to take on new challenges and contribute to the growth of our organization. As a Databricks Developer, you will be...
-
Big Data Engineer
6 days ago
Hyderabad, Telangana, India MSRcosmos LLC Full timeGreetings from MSRcosmos LLC. We are a dynamic organization seeking an experienced professional to fill the role of Databricks Developer.Job DescriptionWe require a highly skilled individual with a minimum of 3 years' experience in Databricks workspace, Databricks notebooks, Job cluster, Delta Lake, Databricks Lakehouse and Unity catalog.The ideal candidate...
-
Senior Azure Databricks Engineer
4 weeks ago
Hyderabad, Telangana, India Innova ESI Full timeAbout the Role : - We are seeking a highly skilled and experienced Senior Azure Databricks Engineer to join our dynamic data engineering team.- As a Senior Azure Databricks Engineer, you will play a critical role in designing, developing, and implementing data solutions on the Azure Databricks platform.- You will be responsible for building and maintaining...
-
Senior Azure Databricks Engineer
3 weeks ago
Hyderabad, Telangana, India Innova ESI Full timeAbout the Role : - We are seeking a highly skilled and experienced Senior Azure Databricks Engineer to join our dynamic data engineering team.- As a Senior Azure Databricks Engineer, you will play a critical role in designing, developing, and implementing data solutions on the Azure Databricks platform.- You will be responsible for building and maintaining...
-
Cloud Data Scientist
6 days ago
Hyderabad, Telangana, India MSRcosmos LLC Full timeWe are MSRcosmos LLC, a forward-thinking organization dedicated to leveraging cutting-edge technology to drive business growth. We're currently seeking a highly skilled Databricks Developer to join our team.Job ResponsibilitiesAs a Databricks Developer, you will play a critical role in designing, building, and maintaining complex data pipelines using...
-
Cloud Data Engineer for Azure Databricks
2 days ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeCompany Overview: Tata Consultancy Services is a global leader in IT services and consulting. Our team of experts provides innovative solutions to clients across various industries.As an Azure Databricks Engineer, you will play a crucial role in designing, developing, and maintaining large-scale data pipelines using Azure Databricks and Spark. Your expertise...
-
Darabricks developer
2 weeks ago
Hyderabad, Telangana, India MSRcosmos LLC Full timeGreetings from MSRcosmos.. We are hiring for Databricks develoepr Experience: 2-5 Years Notice Period: Immediate joiners only Work location: Hyderabad Mode Of work: Work from Office Job Description: Minimum 3 year of experience in Databricks workspace, Databricks notebooks, Job cluster, Delta Lake, Databricks Lakehouse and Unity catalog Minimum 5 years'...
-
Azure Databricks Engineer
3 weeks ago
Hyderabad, Telangana, India Tata Consultancy Services Full timePosition:Azure Databricks EngineerExperience: 6-8 yearsLocation: New Delhi, HyderabadJob Description:Required Technical Skill Set** Azure DatabricksDesired Competencies (Technical/Behavioral Competency)Must-Have**• Qualifications:· 2-5 years of relevant IT experience with good exposure to Cloud technologies.· Experience using Databricks and proficiency...
-
Azure Databricks Data Engineer
3 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeDo you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor Reviews If you are...
-
Senior Data Engineer
3 weeks ago
Hyderabad, Telangana, India Enable Data Incorporated Full timeEnable Data Incorporated is seeking a highly skilled Senior Data Engineer with expertise in cloud technologies, Spark, and Databricks to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem.As a Senior Data...
-
Darabricks developer
2 weeks ago
Hyderabad, Telangana, India MSRcosmos LLC Full timeGreetings from MSRcosmos..We are hiring for Databricks develoeprExperience: 3-7 YearsNotice Period: Immediate joiners onlyWork location: HyderabadMode Of work: Work from OfficeJob Description:- Minimum 3 year of experience in Databricks workspace, Databricks notebooks, Job cluster, Delta Lake, Databricks Lakehouse and Unity catalog- Minimum 3 years'...
-
Darabricks developer
2 weeks ago
Hyderabad, Telangana, India MSRcosmos LLC Full timeGreetings from MSRcosmos..We are hiring for Databricks develoeprExperience: 2-5 YearsNotice Period: Immediate joiners onlyWork location: HyderabadMode Of work: Work from OfficeJob Description:Minimum 3 year of experience in Databricks workspace, Databricks notebooks, Job cluster, Delta Lake, Databricks Lakehouse and Unity catalogMinimum 5 years' experience...
-
Darabricks developer
2 weeks ago
Hyderabad, Telangana, India MSRcosmos LLC Full timeGreetings from MSRcosmos..We are hiring for Databricks develoeprExperience: 3-7 YearsNotice Period: Immediate joiners onlyWork location: HyderabadMode Of work: Work from OfficeJob Description:- Minimum 3 year of experience in Databricks workspace, Databricks notebooks, Job cluster, Delta Lake, Databricks Lakehouse and Unity catalog- Minimum 3 years'...
-
Azure Databricks/PySpark Engineer
3 weeks ago
Hyderabad, Telangana, India IT & Services Full timeJob Description : Data Engineer (Azure Databricks & PySpark)Position : Data EngineerExperience : 3 to 12 yearsPrimary Skills : Azure Databricks, PySpark, SQLSecondary Skills : ADF (Azure Data Factory)Location : Bengaluru/HyderabadMode of Work : HybridNotice Period : 0 to 30 DaysKey Responsibilities :ETL Development & Data Processing :- Design, develop, and...
-
Azure Databricks/PySpark Engineer
2 weeks ago
Hyderabad, Telangana, India IT & Services Full timeJob Description : Data Engineer (Azure Databricks & PySpark)Position : Data EngineerExperience : 3 to 12 yearsPrimary Skills : Azure Databricks, PySpark, SQLSecondary Skills : ADF (Azure Data Factory)Location : Bengaluru/HyderabadMode of Work : HybridNotice Period : 0 to 30 DaysKey Responsibilities :ETL Development & Data Processing :- Design, develop, and...
-
Azure Databricks Data Engineer
3 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeJob Description Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor...
-
Sr. Azure Developer
1 week ago
Hyderabad, Telangana, India MSRcosmos LLC Full timeTitle : Sr. Azure Databrick DeveloperOnly 12+Yrs experience profiles will be consideredKey skills required: Azure Databricks, Pyspark streaming, SQL, JSON data parsing.Roles/Responsibilities:Must have Azure Data factory, Azure Databricks, Azure Synapse and Azure environment exposure.Spark Structured Streaming :Must have experience in developing streaming...
-
Darabricks developer
2 weeks ago
Hyderabad, Telangana, India MSRcosmos LLC Full timeGreetings from MSRcosmos..We are hiring for Databricks develoeprExperience: 2-5 YearsNotice Period: Immediate joiners onlyWork location: HyderabadMode Of work: Work from OfficeJob Description:Minimum 3 year of experience in Databricks workspace, Databricks notebooks, Job cluster, Delta Lake, Databricks Lakehouse and Unity catalogMinimum 5 years' experience...
-
Darabricks developer
2 weeks ago
Hyderabad, Telangana, India MSRcosmos LLC Full timeGreetings from MSRcosmos..We are hiring for Databricks develoeprExperience: 2-5 YearsNotice Period: Immediate joiners onlyWork location: HyderabadMode Of work: Work from OfficeJob Description:Minimum 3 year of experience in Databricks workspace, Databricks notebooks, Job cluster, Delta Lake, Databricks Lakehouse and Unity catalogMinimum 5 years' experience...
-
Azure Databricks Engineer
3 weeks ago
Hyderabad, Telangana, India Leuwint Technologies Full timeJob Description :- Minimum 4 years of experience in relevant field.- Hands on experience in Databricks, SQL, Azure Data Factory, Azure DevOps- Strong expertise in Microsoft Azure cloud platform services (Azure Data Factory, Azure Data Bricks, Azure SQL Database, Azure Data Lake Storage, Azure Synapse Analytics).- Proficient in CI-CD pipelines in Azure DevOps...