Data Engineer
4 weeks ago
Job Title: Data Engineer - Databricks Expert
Job Summary:
We are seeking a highly skilled Data Engineer with expertise in Databricks and Spark to join our team at Hero Fincorp Ltd. As a Data Engineer, you will be responsible for designing and implementing highly performant data ingestion and transformation pipelines from multiple sources using Databricks and Spark.
Key Responsibilities:
- Designing and implementing data ingestion and transformation pipelines using Databricks and Spark
- Streaming and batch processes in Databricks
- Providing technical guidance for complex problems and Spark dataframes
- Developing scalable and reusable frameworks for ingestion and transformation of large data sets
- Data quality system and process design and implementation
- Integrating end-to-end data pipeline to take data from source systems to target data repositories ensuring quality and consistency of data is maintained at all times
- Working with other members of the project team to support delivery of additional project components (Reporting tools, API interfaces, Search)
- Evaluating performance and applicability of multiple tools against customer requirements
- Working within an Agile delivery/DevOps methodology to deliver proof of concept and production implementation in iterative sprints
Eligibility Criteria:
- B.E/B.Tech in any specialization, BCA, M.Tech in any specialization, MCA
- 3+ years of experience in data engineering on Databricks platforms over AWS/Azure
Primary Skills:
- Direct experience of building data pipelines using Databricks Spark
- Building data integration with Python
- Hands-on experience designing and delivering solutions using the Azure Data Analytics platform
- Experience building data warehouse solutions using ETL/ELT tools like Informatica, Talend
- Comprehensive understanding of data management best practices including demonstrated experience with data profiling, sourcing, and cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking, and matching
Technical Skills:
- Must have orchestrated at least 3 projects using any of the cloud platforms (GCP, Azure, AWS etc.)
- Must have orchestrated at least 2 projects using Databricks over AWS/Azure
- Must have worked on any cloud PaaS/SaaS database/DWH such as AWS redshift/Big Query/Snowflake
- Expertise in programming languages like Python or PySpark or Scala or SQL/PLSQL
- Python/Spark hands-on experience from data engineering perspective
- Experience in at least one of the major ETL tools (Talend + TAC, SSIS, Informatica)
- Experience with Github and Jenkins CI/CD or similar DevOps tools
- Experience with ETL tooling, migrating ETL code from one technology to another
- Hands-on experience in Visualization/Dashboard tools (PowerBI, Tableau, Qliksense)
Management Skills:
- Ability to handle given tasks and projects simultaneously in an organized and timely manner
- Daily project updates and ability to identify project risks & mitigations
Soft Skills:
- Good communication skills, verbal and written
- Attention to details
- Positive attitude and confident
-
Data Engineer
1 month ago
Delhi NCR, India Shamrock Value Pvt Ltd Full timeJob Title: Data EngineerJob Summary:We are seeking a highly skilled Data Engineer to join our team at Shamrock Value Pvt Ltd. The successful candidate will be responsible for designing, building, and maintaining large-scale data pipelines and systems to support our business operations.Key Responsibilities:Design and implement scalable data pipelines to...
-
Cloud Data Engineer
3 weeks ago
Delhi NCR, India Polaris School of Technology Full timeCloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to join our team at Polaris School of Technology. As a Cloud Data Engineer, you will play a crucial role in designing, building, and maintaining our cloud-based data systems. Your primary focus will be on ensuring the scalability, reliability, and security of our data infrastructure.Key...
-
Data Engineering Professional
3 weeks ago
Delhi NCR, India Shamrock Value Pvt Ltd Full timeJob Title: Data EngineerAbout the Role:We are seeking a skilled Data Engineer to join our team at Shamrock Value Pvt Ltd. As a Data Engineer, you will play a crucial role in designing, building, and maintaining scalable data pipelines and ensuring data quality, enabling our organization to make informed decisions.Key Responsibilities:Data Pipeline...
-
Lead data engineer
5 days ago
Delhi, India Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
AWS Data Engineer
1 week ago
delhi, India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
2 weeks ago
delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
AWS Data Engineer
3 months ago
Delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
Aws data engineer
1 week ago
Delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
Senior Data Engineer
3 weeks ago
Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full timeAbout Eucloid Data SolutionsEucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. We offer bespoke, full stack and data-driven approach to solve highly complex and large-scale business problems for some of the biggest Fortune 500...
-
Data Engineer
3 weeks ago
Delhi NCR, India Shamrock Value Pvt Ltd Full timeJob Description : Hiring : Data Engineer (Female Candidates Only)Location : GurugramExperience : 2+ YearsSalary : Up to 15 LPA(Depends on your interview, experience and current CTC)Qualification : Master's/Bachelor's degree in Engineering, Computer Science, Math, or StatisticsAvailability : Immediate JoinersSkills : Python, SQL, Spark, Azure...
-
Data Engineer
2 months ago
Delhi NCR, India Shamrock Value Pvt Ltd Full timeJob Description :Hiring : Data Engineer (Female Candidates Only)Location : GurugramExperience : 2+ YearsSalary : Up to 15 LPA(Depends on your interview, experience and current CTC)Qualification : Master's/Bachelor's degree in Engineering, Computer Science, Math, or StatisticsAvailability : Immediate JoinersSkills : Python, SQL, Spark, Azure...
-
Senior Data Engineer
3 weeks ago
Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full timeAbout the Role:Eucloid Data Solutions Pvt Ltd is seeking a highly skilled Senior Data Engineer to join our Data Platform team. The successful candidate will have hands-on expertise in Databricks and will be responsible for designing and building data infrastructure to support various business applications.Key Responsibilities:Design, implementation, and...
-
Data Engineer
13 hours ago
Noida, Delhi NCR, India Syncwell Infotech Private Limited Full timeRole and ResponsibilitiesDesign, develop and deliver the building of ADF pipelines across various integration points for the Accounting & Reporting Stream.Create and maintain scalable data pipelines using PySpark and ETL workflows using Azure Databricks and Azure Data FactoryData Modelling and Architecture: Build and optimize data models and structures to...
-
Data Engineer
1 month ago
Delhi NCR, India Polaris School of Technology Full timeAbout UsWe are a revolutionary B2B Ed-Tech startup based out of Noida, India. Our mission is to empower educators and content creators to seamlessly transition online, offering live classes, storage solutions, transaction features, content monetization, and more - all in one super app.What We DoWe thrive in the post-pandemic era, supporting a whopping 1...
-
Data Engineer
3 weeks ago
Delhi NCR, India Symbiosis Management Consultants Full timeData Engineering RolesWe are looking for an experienced Data Engineer to join our team at Symbiosis Management Consultants. As a data engineer, you will play a critical role in designing and implementing scalable, reliable, and maintainable data architectures. Your expertise in data integration, database management, and data modeling will enable us to make...
-
Senior Data Engineer
3 weeks ago
Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time**Job Title:** Senior Data Engineer - Databricks Expert**About Eucloid Data Solutions Pvt Ltd**Eucloid Data Solutions Pvt Ltd is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning, and Data engineering. Our team supports various business applications by developing data...
-
Data Engineer
3 weeks ago
Delhi NCR, India Grip Invest Full timeAbout the RoleWe are seeking a highly skilled Data Scientist to join our team at Grip Invest. As a Data Scientist, you will play a key role in driving business growth through data-driven insights and strategic recommendations.Key Responsibilities- Support business decision-making by analyzing and interpreting large datasets to identify trends and patterns-...
-
Senior Data Engineer
2 months ago
Delhi NCR, India Symbiosis Management Consultants Full timeRoles & Responsibilities : - Data Architecture Design : Design and implement scalable, reliable, and maintainable data architectures.- Data Integration : Develop ETL processes to integrate data from various sources into a centralized data warehouse. Ensure data quality and integrity throughout the integration process.- Database Management : Administer and...
-
Senior Data Engineer
3 weeks ago
Gurgaon/Gurugram/Chennai/Hyderabad/Delhi NCR, India Eucloid Data Solutions Pvt Ltd Full timeAbout the Role:Eucloid Data Solutions Pvt Ltd is seeking a seasoned Data Engineer with expertise in Databricks to join our Data Platform team. As a vital member of our team, you will play a key role in developing data infrastructure on Databricks for our clients.Key Responsibilities:Design, implementation, and improvement of data pipelines for reliability...
-
Data Analyst
1 month ago
Delhi NCR, India Grip Invest Full timeAbout the RoleWe are seeking a highly skilled Data Scientist to join our team at Grip Invest. As a key member of our data analytics team, you will play a critical role in driving business decisions through data-driven insights.Key ResponsibilitiesSupport business decision making by deriving actionable insights from structured and unstructured dataConduct...