Senior Data Engineer
2 weeks ago
Role Summary
We are seeking a highly skilled Senior Data Engineer to join our team at AsalJobs. The ideal candidate will have a strong background in data engineering, with expertise in Databricks, Spark, and Azure cloud environment.
Key Responsibilities
- Design, implement, and optimize end-to-end data pipelines using Azure Databricks, ensuring reliability, scalability, and performance.
- Utilize Azure Databricks for data transformation tasks, including cleansing, aggregation, and enrichment of datasets.
- Implement automation for data workflows and monitoring pipelines to ensure data integrity and availability.
- Collaborate with actuarial scientists and analysts to develop data-driven solutions.
Requirements
- 6-10 years of hands-on experience in SQL and Python development.
- Proven track record of building complex data validation and transformation projects using both SQL and Python.
- Strong practical knowledge in SQL and Python, with an emphasis on creating reusable code.
- Experience with data manipulation tools and libraries, including Pandas, NumPy, and data integration tools and techniques.
- Proficient in writing base code that dynamically generates multiple code instances based on a configuration file.
- Experience working in Azure cloud environment, particularly with data lakes.
Preferred Qualifications
- Knowledge of Databricks, Spark, or similar frameworks for processing large datasets.
- Knowledge of Apache Spark, including Spark SQL, DataFrame/Dataset API.
- Proficiency in setting up and managing Databricks clusters, notebooks, and jobs within the Azure ecosystem.
What We Offer
As a Senior Data Engineer at AsalJobs, you will have the opportunity to work on challenging projects, collaborate with a talented team, and develop your skills in data engineering.
-
Senior Java Engineer
5 days ago
Remote, India Data caliper Full timeJob Title: Senior Java EngineerAbout the Role:Data Caliper is seeking a highly skilled Senior Java Engineer to lead the development of our Java-based applications. The successful candidate will have a deep understanding of Java programming principles and will be able to design, develop, and maintain robust and scalable Java applications.Key...
-
Senior Data Engineer
2 weeks ago
Remote, India Overture Rede Private Limited. Full timeJob Title: Senior Spark DeveloperJob Summary:Overture Rede Private Limited is seeking a highly skilled Senior Spark Developer to join our team. As a Senior Spark Developer, you will be responsible for designing, developing, and implementing data pipelines and data lakes using Spark, EMR, and Hadoop.Key Responsibilities:Design and develop data processing...
-
Senior Data Migration Engineer
2 weeks ago
Remote, India BlueByte Technologies Full timeJob Title: Senior Data Migration EngineerJob Summary:We are seeking a highly skilled Senior Data Migration Engineer to lead our cloud migration project from Google Cloud Platform (GCP) to Snowflake. The successful candidate will have extensive experience in data engineering, cloud migration, and data transformation using dbt.Key Responsibilities:Lead the...
-
Senior Data Engineer
2 weeks ago
Remote/Pune, India TVARIT Full timeSenior Data EngineerTVARIT GmbH is a leading developer of artificial intelligence solutions for the manufacturing, automotive, and process industries. We are seeking a highly skilled Senior Data Engineer to join our team and contribute to the development of our data infrastructure.Key Responsibilities:Design and implement scalable data infrastructure to...
-
Senior Data Engineer
2 weeks ago
Remote/Pune, India TVARIT Full timeSenior Data EngineerTVARIT GmbH is a leading provider of artificial intelligence solutions for the manufacturing, automotive, and process industries. We are seeking a highly skilled Senior Data Engineer to join our team and contribute to the development of our data infrastructure.Key Responsibilities:Design and implement scalable data infrastructure to...
-
Azure Data Architect
5 months ago
Remote, India Data PlatformExperts Full timeJob Description: Azure Data Engineer (Architect Level) We are seeking an experienced and highly skilled Azure Data Engineer at the Architect level to lead the design and implementation of complex data solutions on the Microsoft Azure platform. As an Azure Data Engineer Architect, you will be responsible for providing technical expertise, guiding the...
-
Senior Data Architect
2 weeks ago
Remote, India Hunarstreet Technologies Pvt Ltd Full timeSenior Data EngineerHunarstreet Technologies Pvt Ltd is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and building our data pipeline architecture, ensuring seamless data flow and collection for cross-functional teams.The ideal candidate will have a strong...
-
Azure Data Architect
5 months ago
Remote, India Data PlatformExperts Full time**Job Description: Azure Data Architect** **Key Responsibilities**: - **Design and Implementation**: - Design and implement end-to-end data solutions (data models, pipelines, data lakes, data warehouses) in Azure. - Optimize and maintain existing Azure data structures and integration processes. - Ensure architectural solutions are scalable, maintainable,...
-
Senior Azure Data Engineer
3 weeks ago
Remote, IN Quantumbricks Full timeJob Overview : We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team. The ideal candidate will have over 10 years of experience in designing, developing, and implementing data solutions on Azure. This role involves working closely with cross-functional teams to build scalable, efficient, and secure data platforms. You...
-
Senior Data Architect
2 weeks ago
Remote, India Hunarstreet Technologies Pvt Ltd Full timeSenior Data EngineerHunarstreet Technologies Pvt Ltd is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and building our data pipeline architecture, ensuring seamless data flow and collection for cross-functional teams.We are looking for an experienced data...
-
Senior Data Engineer
3 weeks ago
Remote, IN Quantumbricks Full timeJob Summary : We are seeking a highly skilled Senior Data Engineer with over 10 years of experience in designing, developing, and managing robust data pipelines, with specific expertise in Informatica Intelligent Cloud Services (IICS). The ideal candidate will have extensive experience in handling complex ETL/ELT processes, cloud data integration, and data...
-
Senior Data Architect
2 weeks ago
Remote, India Nthinsight Full timeJob Title: Senior Data EngineerJob Summary:We are seeking a highly skilled and experienced Senior Data Engineer to join our team at Nthinsight. As a Senior Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support the organization's data needs.Key Responsibilities:Collaborate with...
-
Data Platform Engineer
5 days ago
Remote, India Yellow Full timeAbout the RoleWe are looking for an experienced Data Platform Engineer to join our team at Yellow. As a key member of our fast-paced team, you will work closely with senior engineers to design, implement, and optimize data pipelines and systems using cutting-edge open-source tools.Key ResponsibilitiesDesign and build scalable ETL/ELT pipelines using tools...
-
Senior Data Analytics Engineer
2 weeks ago
Remote, India PROTEGRITY INDIA PRIVATE LIMITED Full timeSenior Data Analytics Engineer - Business IntelligenceProtegrity is seeking a highly skilled Senior Data Analytics Engineer to join our Business Intelligence Team. This role is a remote opportunity.As a Senior Data Analytics Engineer, you will be responsible for enhancing Protegrity's data analytics and information reporting capabilities, utilizing modern...
-
AWS Data Engineer
2 weeks ago
Remote, India Kooe Private Limited Full timeSenior AWS Data EngineerWe are seeking a highly skilled Senior AWS Data Engineer to join our team at Kooe Private Limited. As a key member of our engineering team, you will be responsible for designing, building, and maintaining large-scale data pipelines using cloud-based technologies.Key Responsibilities:Design and implement data pipelines using AWS...
-
Senior AWS Data Engineer
3 weeks ago
Remote, IN Quantumbricks Full timeJob Summary. We are seeking a highly skilled and experienced Senior AWS Data Engineer to lead our cloud data architecture, design, and development initiatives. The ideal candidate will have deep expertise in building and managing large-scale data pipelines and solutions on AWS, as well as strong experience in data architecture, ETL, and real-time data...
-
Senior Data Engineer
4 weeks ago
Remote, India Hunarstreet Technologies Pvt Ltd Full timeThe Senior Data Engineer will be responsible for building and extending our data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys working with big data and building systems from the ground up. You will collaborate with our...
-
Senior Data Analytics Engineer
2 weeks ago
Remote, India PROTEGRITY INDIA PRIVATE LIMITED Full timeSenior Data Analytics EngineerProtegrity is seeking a highly skilled Senior Data Analytics Engineer to join our Business Intelligence Team. This is a remote role that requires a strong passion for data analytics and a talent for driving business value.Key Responsibilities:Strengthen Protegrity's data analytics and information reporting capabilities using...
-
Senior Data Engineering Specialist
1 week ago
Remote/Ukraine, India AccedePro Private Limited Full timeWe are seeking a highly skilled Senior Data Engineering Specialist to lead our data engineering team in Romania and Ukraine. The ideal candidate will have a strong background in data engineering, with expertise in SQL, Python, and Databricks. They will be responsible for designing and implementing large-scale data processing systems, as well as ensuring the...
-
Senior Data Architect
2 weeks ago
Remote, India Gama Advisory Services LLP Full timeJob Title: Senior Data ArchitectAbout the Role:We are seeking a highly skilled Senior Data Architect to design and implement our data strategy at Gama Advisory Services LLP.Key Responsibilities:Develop and execute the overall data architecture strategy, aligning it with business objectives and ensuring data quality, consistency, and accessibility across the...