Data Engineer

3 weeks ago

Delhi NCR, India Hero Fincorp Ltd Full time

**Job Title:** Data Engineer - Databricks and Spark Specialist at Hero Fincorp Ltd

**Key Responsibilities:**

  • Design and implement high-performance data ingestion and transformation pipelines from multiple sources using Databricks and Spark.
  • Develop streaming and batch processes in Databricks.
  • Provide technical guidance for complex problems and Spark dataframes.
  • Develop scalable and reusable frameworks for ingestion and transformation of large data sets.
  • Design and implement data quality systems and processes.
  • Integrate end-to-end data pipelines to take data from source systems to target data repositories, ensuring quality and consistency of data at all times.
  • Collaborate with project team members to support delivery of additional project components, including reporting tools, API interfaces, and search functionality.
  • Evaluate the performance and applicability of multiple tools against customer requirements.
  • Work within an Agile delivery and DevOps methodology to deliver proof of concept and production implementation in iterative sprints.

**Other Responsibilities:**

  • Availability during month-end deck generation, may be sometime during week-end/holidays.

**Eligibility Criteria for the Job:**

  • Education: B.E/B.Tech in any specialization, BCA, M.Tech in any specialization, MCA.
  • No age bar.
  • Work Experience: 3+ years of experience in data engineering on Databricks platforms over AWS/Azure.

**Primary Skills:**

  • Direct experience of building data pipelines using Databricks Spark.
  • Building data integration with Python.
  • Hands-on experience designing and delivering solutions using the Azure Data Analytics platform.
  • Experience building data warehouse solutions using ETL/ELT tools like Informatica, Talend.
  • Comprehensive understanding of data management best practices, including demonstrated experience with data profiling, sourcing, and cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking, and matching.

**Technical Skills:**

  • Must have orchestrated at least 3 projects using any of the cloud platforms (GCP, Azure, AWS etc.).
  • Must have orchestrated at least 2 projects using Databricks over AWS/Azure.
  • Must have worked on any cloud PaaS/SaaS database/DWH such as AWS redshift/ Big Query/ Snowflake.
  • Expertise in programming languages like Python or PySpark or Scala or SQL/PLSQL.
  • Python/Spark hands-on experience from a data engineering perspective is a must.
  • Experience in at least one of the major ETL tools (Talend + TAC, SSIS, Informatica) will be an added advantage.
  • Experience with GitHub and Jenkins CI/CD or similar DevOps tools.
  • Experience with ETL tooling, migrating ETL code from one technology to another will be a benefit.
  • Hands-on experience in Visualization/Dashboard tools (PowerBI, Tableau, Qliksense).

**Management Skills:**

  • Ability to handle given tasks and projects simultaneously in an organized and timely manner.
  • Daily project updates and ability to identify project risks and mitigations.

**Soft Skills:**

  • Good communication skills, verbal and written.
  • Attention to details.
  • Positive attitude and confidence.

  • Data Engineer

    1 month ago

    Delhi NCR, India Shamrock Value Pvt Ltd Full time

    Job Title: Data EngineerJob Summary:We are seeking a highly skilled Data Engineer to join our team at Shamrock Value Pvt Ltd. The successful candidate will be responsible for designing, building, and maintaining large-scale data pipelines and systems to support our business operations.Key Responsibilities:Design and implement scalable data pipelines to...

  • Cloud Data Engineer

    3 weeks ago

    Delhi NCR, India Polaris School of Technology Full time

    Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to join our team at Polaris School of Technology. As a Cloud Data Engineer, you will play a crucial role in designing, building, and maintaining our cloud-based data systems. Your primary focus will be on ensuring the scalability, reliability, and security of our data infrastructure.Key...

  • Data Engineering Professional

    3 weeks ago

    Delhi NCR, India Shamrock Value Pvt Ltd Full time

    Job Title: Data EngineerAbout the Role:We are seeking a skilled Data Engineer to join our team at Shamrock Value Pvt Ltd. As a Data Engineer, you will play a crucial role in designing, building, and maintaining scalable data pipelines and ensuring data quality, enabling our organization to make informed decisions.Key Responsibilities:Data Pipeline...

  • Lead data engineer

    5 days ago

    Delhi, India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • AWS Data Engineer

    1 week ago

    delhi, India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • AWS Data Engineer

    2 weeks ago

    delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • AWS Data Engineer

    3 months ago

    Delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...

  • Aws data engineer

    1 week ago

    Delhi, India ITI Data Full time

    Job DescriptionWe are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....

  • Senior Data Engineer

    3 weeks ago

    Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time

    About Eucloid Data SolutionsEucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. We offer bespoke, full stack and data-driven approach to solve highly complex and large-scale business problems for some of the biggest Fortune 500...

  • Data Engineer

    3 weeks ago

    Delhi NCR, India Shamrock Value Pvt Ltd Full time

    Job Description : Hiring : Data Engineer (Female Candidates Only)Location : GurugramExperience : 2+ YearsSalary : Up to 15 LPA(Depends on your interview, experience and current CTC)Qualification : Master's/Bachelor's degree in Engineering, Computer Science, Math, or StatisticsAvailability : Immediate JoinersSkills : Python, SQL, Spark, Azure...

  • Data Engineer

    2 months ago

    Delhi NCR, India Shamrock Value Pvt Ltd Full time

    Job Description :Hiring : Data Engineer (Female Candidates Only)Location : GurugramExperience : 2+ YearsSalary : Up to 15 LPA(Depends on your interview, experience and current CTC)Qualification : Master's/Bachelor's degree in Engineering, Computer Science, Math, or StatisticsAvailability : Immediate JoinersSkills : Python, SQL, Spark, Azure...

  • Data Engineer

    4 weeks ago

    Delhi NCR, India Hero Fincorp Ltd Full time

    Job Title: Data Engineer - Databricks ExpertJob Summary:We are seeking a highly skilled Data Engineer with expertise in Databricks and Spark to join our team at Hero Fincorp Ltd. As a Data Engineer, you will be responsible for designing and implementing highly performant data ingestion and transformation pipelines from multiple sources using Databricks and...

  • Senior Data Engineer

    3 weeks ago

    Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time

    About the Role:Eucloid Data Solutions Pvt Ltd is seeking a highly skilled Senior Data Engineer to join our Data Platform team. The successful candidate will have hands-on expertise in Databricks and will be responsible for designing and building data infrastructure to support various business applications.Key Responsibilities:Design, implementation, and...

  • Data Engineer

    11 hours ago

    Noida, Delhi NCR, India Syncwell Infotech Private Limited Full time

    Role and ResponsibilitiesDesign, develop and deliver the building of ADF pipelines across various integration points for the Accounting & Reporting Stream.Create and maintain scalable data pipelines using PySpark and ETL workflows using Azure Databricks and Azure Data FactoryData Modelling and Architecture: Build and optimize data models and structures to...

  • Data Engineer

    1 month ago

    Delhi NCR, India Polaris School of Technology Full time

    About UsWe are a revolutionary B2B Ed-Tech startup based out of Noida, India. Our mission is to empower educators and content creators to seamlessly transition online, offering live classes, storage solutions, transaction features, content monetization, and more - all in one super app.What We DoWe thrive in the post-pandemic era, supporting a whopping 1...

  • Data Engineer

    3 weeks ago

    Delhi NCR, India Symbiosis Management Consultants Full time

    Data Engineering RolesWe are looking for an experienced Data Engineer to join our team at Symbiosis Management Consultants. As a data engineer, you will play a critical role in designing and implementing scalable, reliable, and maintainable data architectures. Your expertise in data integration, database management, and data modeling will enable us to make...

  • Senior Data Engineer

    2 weeks ago

    Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time

    **Job Title:** Senior Data Engineer - Databricks Expert**About Eucloid Data Solutions Pvt Ltd**Eucloid Data Solutions Pvt Ltd is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning, and Data engineering. Our team supports various business applications by developing data...

  • Data Engineer

    3 weeks ago

    Delhi NCR, India Grip Invest Full time

    About the RoleWe are seeking a highly skilled Data Scientist to join our team at Grip Invest. As a Data Scientist, you will play a key role in driving business growth through data-driven insights and strategic recommendations.Key Responsibilities- Support business decision-making by analyzing and interpreting large datasets to identify trends and patterns-...

  • Senior Data Engineer

    2 months ago

    Delhi NCR, India Symbiosis Management Consultants Full time

    Roles & Responsibilities : - Data Architecture Design : Design and implement scalable, reliable, and maintainable data architectures.- Data Integration : Develop ETL processes to integrate data from various sources into a centralized data warehouse. Ensure data quality and integrity throughout the integration process.- Database Management : Administer and...

  • Senior Data Engineer

    3 weeks ago

    Gurgaon/Gurugram/Chennai/Hyderabad/Delhi NCR, India Eucloid Data Solutions Pvt Ltd Full time

    About the Role:Eucloid Data Solutions Pvt Ltd is seeking a seasoned Data Engineer with expertise in Databricks to join our Data Platform team. As a vital member of our team, you will play a key role in developing data infrastructure on Databricks for our clients.Key Responsibilities:Design, implementation, and improvement of data pipelines for reliability...