MSRcosmos - Senior Data Engineer - Azure Databricks
5 days ago
About the Role : We are seeking a highly experienced Senior Data Engineer with over 10 years of expertise in the big data domain. The ideal candidate will have strong proficiency in Azure Databricks, Spark Streaming, Python, PySpark, and SQL, along with a proven track record in designing and implementing robust data pipelines and data lake solutions. Key Responsibilities : Data Engineering & Development : - Develop and maintain scalable data pipelines using PySpark, Python, and Spark Streaming. - Implement ETL/ELT jobs for data ingestion and processing in data lakes. Databricks Expertise : - Utilize Databricks workspace, notebooks, job clusters, Delta Lake, Databricks Lakehouse, and Unity Catalog effectively. Big Data Management : - Design and implement data lake architectures and data warehouse solutions. - Work with SQL Server, NoSQL, Spark SQL for data modeling, query optimization, and parallel processing. Streaming Data Processing : - Integrate Kafka and Pub/Sub technologies for real-time data processing workflows. Agile Methodology : - Contribute to Agile development practices, including SCRUM methodologies and Application Lifecycle Management (ALM). Key Skills & Experience : - 10 years in IT within the big data domain, specializing in Hadoop, data lakes, and data engineering. - 3-4 years of hands-on experience with Databricks. - 5 years of strong development experience in PySpark and Python. - 6 years in designing and implementing data pipelines. - Proficient in Spark Streaming, SQL Server, NoSQL, Spark SQL, and data modeling. - Familiar with identity & access management, query optimization, and parallel processing. - Strong problem-solving skills with excellent communication abilities. - Knowledge of Agile development practices, SCRUM, and ALM. (ref:hirist.tech)
-
Senior Azure Data Architect
1 day ago
Hyderabad, Telangana, India MSRcosmos LLC Full timeJob DescriptionWe are seeking a highly skilled Senior Azure Data Architect to join MSRcosmos LLC.Company OverviewAt MSRcosmos LLC, we pride ourselves on our innovative approach to data management and analytics. Our team is dedicated to providing cutting-edge solutions that drive business growth and success.Job DescriptionThe successful candidate will be...
-
Data Engineer
3 days ago
Hyderabad, Telangana, India MSRcosmos LLC Full timeAt MSRcosmos LLC, we're seeking a skilled Data Engineer with expertise in Databricks to join our team.Job OverviewWe're looking for an experienced professional to lead the design and implementation of data pipelines using Databricks, ensuring seamless data ingestion, processing, and storage.Key ResponsibilitiesDevelop and maintain scalable data pipelines...
-
Databricks Developer
3 days ago
Hyderabad, Telangana, India MSRcosmos LLC Full timeAt MSRcosmos LLC, we are on a mission to harness the power of data.Greetings from MSRcosmos!We are seeking a skilled Databricks Developer to join our team.About Us:MSRcosmos LLC is a cutting-edge organization that leverages advanced technologies to drive innovation. Our team works collaboratively to design and develop scalable solutions that meet complex...
-
Databricks Developer Expert
2 days ago
Hyderabad, Telangana, India MSRcosmos LLC Full timeData Engineer PositionMSRcosmos LLC seeks an experienced Data Engineer to develop and maintain large-scale data systems. The ideal candidate will have a strong background in designing and implementing data pipelines and ETL/ELT jobs. They will collaborate with cross-functional teams to identify business requirements and design solutions. Key responsibilities...
-
Senior Azure Databricks Engineer
5 days ago
Hyderabad, Telangana, India Innova ESI Full timeAbout the Role : - We are seeking a highly skilled and experienced Senior Azure Databricks Engineer to join our dynamic data engineering team. - As a Senior Azure Databricks Engineer, you will play a critical role in designing, developing, and implementing data solutions on the Azure Databricks platform. - You will be responsible for building and maintaining...
-
Senior Azure Databricks Engineer
3 weeks ago
Hyderabad, Telangana, India Innova ESI Full timeAbout the Role : - We are seeking a highly skilled and experienced Senior Azure Databricks Engineer to join our dynamic data engineering team.- As a Senior Azure Databricks Engineer, you will play a critical role in designing, developing, and implementing data solutions on the Azure Databricks platform.- You will be responsible for building and maintaining...
-
Big Data Engineer
2 days ago
Hyderabad, Telangana, India MSRcosmos LLC Full timeJob DescriptionWe are seeking an experienced Databricks developer to join MSRcosmos LLC. The ideal candidate will have a strong background in developing data pipelines and ETL/ELT jobs, as well as experience working with Spark Streaming and Kafka/Pub-Sub.Key Responsibilities:Design and develop data pipelines and ETL/ELT jobs to ingest and process data in a...
-
Azure Databricks Engineer
2 days ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeRole: Databricks DeveloperAbout the Job: We are seeking a highly skilled Databricks Developer to join our team at Tata Consultancy Services. The successful candidate will design and implement efficient data ingestion pipelines from multiple sources, ensuring high-quality and consistent data.Key Responsibilities:Designing and implementing end-to-end data...
-
Azure Databricks Specialist
3 days ago
Hyderabad, Telangana, India Tata Consultancy Services Full timeTata Consultancy Services is a global leader in digital transformation, and we are seeking an exceptional Azure Databricks Specialist to join our team. As a key member of our data engineering group, you will be responsible for designing, building, and maintaining large-scale data architectures on the Microsoft Azure platform.The ideal candidate will have a...
-
Darabricks developer
3 weeks ago
Hyderabad, Telangana, India MSRcosmos LLC Full timeGreetings from MSRcosmos.. We are hiring for Databricks develoepr Experience: 2-5 Years Notice Period: Immediate joiners only Work location: Hyderabad Mode Of work: Work from Office Job Description: Minimum 3 year of experience in Databricks workspace, Databricks notebooks, Job cluster, Delta Lake, Databricks Lakehouse and Unity catalog Minimum 5 years'...
-
Darabricks developer
3 days ago
Hyderabad, Telangana, India MSRcosmos LLC Full timeGreetings from MSRcosmos.. We are hiring for Databricks develoepr Experience: 3-7 Years Notice Period: Immediate joiners only Work location: Hyderabad Mode Of work: Work from Office Job Description: Minimum 3 year of experience in Databricks workspace, Databricks notebooks, Job cluster, Delta Lake, Databricks Lakehouse and Unity catalog Minimum 3 years'...
-
Azure Databricks Data Engineer
3 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeDo you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor Reviews If you are...
-
Senior Data Engineer
3 weeks ago
Hyderabad, Telangana, India Enable Data Incorporated Full timeEnable Data Incorporated is seeking a highly skilled Senior Data Engineer with expertise in cloud technologies, Spark, and Databricks to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem.As a Senior Data...
-
Azure Databricks Engineer
2 days ago
Hyderabad, Telangana, India AIDEN AI PRIVATE LIMITED Full timeCompany OverviewAIDEN AI PRIVATE LIMITED is a leading company in the field of data engineering, specializing in data migration and cloud-based solutions. We are committed to delivering high-quality services to our clients and strive to be the go-to partner for all their data-related needs.Job SummaryWe are looking for a talented Azure Databricks Engineer to...
-
Azure Databricks/PySpark Engineer
3 weeks ago
Hyderabad, Telangana, India IT & Services Full timeJob Description : Data Engineer (Azure Databricks & PySpark)Position : Data EngineerExperience : 3 to 12 yearsPrimary Skills : Azure Databricks, PySpark, SQLSecondary Skills : ADF (Azure Data Factory)Location : Bengaluru/HyderabadMode of Work : HybridNotice Period : 0 to 30 DaysKey Responsibilities :ETL Development & Data Processing :- Design, develop, and...
-
Azure Databricks/PySpark Engineer
3 weeks ago
Hyderabad, Telangana, India IT & Services Full timeJob Description : Data Engineer (Azure Databricks & PySpark)Position : Data EngineerExperience : 3 to 12 yearsPrimary Skills : Azure Databricks, PySpark, SQLSecondary Skills : ADF (Azure Data Factory)Location : Bengaluru/HyderabadMode of Work : HybridNotice Period : 0 to 30 DaysKey Responsibilities :ETL Development & Data Processing :- Design, develop, and...
-
Senior Big Data Architect
5 days ago
Hyderabad, Telangana, India MSR IT Services Full time**Role Overview:**We are seeking a seasoned Senior Data Engineer with over 10 years of expertise in big data domain to lead our data engineering efforts.The successful candidate will have a deep understanding of Azure Databricks, Spark Streaming, Python, PySpark, and SQL, and be able to design and implement robust data pipelines and data lake solutions.Key...
-
Sr. Azure Developer
1 day ago
Hyderabad, Telangana, India MSRcosmos LLC Full timeTitle : Sr. Azure Databrick DeveloperOnly 12+Yrs experience profiles will be consideredKey skills required:Azure Databricks, Pyspark streaming, SQL, JSON data parsing.Roles/Responsibilities:Must have Azure Data factory, Azure Databricks, Azure Synapse and Azure environment exposure.Spark Structured Streaming :Must have experience in developing streaming...
-
Azure Databricks Data Engineer
3 weeks ago
Hyderabad, Telangana, India Alignity Solutions Full timeJob Description Do you love a career where you Experience, Grow & Contribute at the same time, while earning at least 10% above the market? If so, we are excited to have bumped onto you. Learn how we are redefining the meaning of work, and be a part of the team raved by Clients, Job-seekers and Employees.Jobseeker Video Testimonials Employee Glassdoor...
-
Darabricks developer
3 weeks ago
Hyderabad, Telangana, India MSRcosmos LLC Full timeGreetings from MSRcosmos..We are hiring for Databricks develoeprExperience: 2-5 YearsNotice Period: Immediate joiners onlyWork location: HyderabadMode Of work: Work from OfficeJob Description:Minimum 3 year of experience in Databricks workspace, Databricks notebooks, Job cluster, Delta Lake, Databricks Lakehouse and Unity catalogMinimum 5 years' experience...