Data Engineer

5 days ago

Delhi NCR, India Hero Fincorp Ltd Full time

**Job Title:** Data Engineer - Databricks and Spark Specialist at Hero Fincorp Ltd

**Key Responsibilities:**

  • Design and implement high-performance data ingestion and transformation pipelines from multiple sources using Databricks and Spark.
  • Develop streaming and batch processes in Databricks.
  • Provide technical guidance for complex problems and Spark dataframes.
  • Develop scalable and reusable frameworks for ingestion and transformation of large data sets.
  • Design and implement data quality systems and processes.
  • Integrate end-to-end data pipelines to take data from source systems to target data repositories, ensuring quality and consistency of data at all times.
  • Collaborate with project team members to support delivery of additional project components, including reporting tools, API interfaces, and search functionality.
  • Evaluate the performance and applicability of multiple tools against customer requirements.
  • Work within an Agile delivery and DevOps methodology to deliver proof of concept and production implementation in iterative sprints.

**Other Responsibilities:**

  • Availability during month-end deck generation, may be sometime during week-end/holidays.

**Eligibility Criteria for the Job:**

  • Education: B.E/B.Tech in any specialization, BCA, M.Tech in any specialization, MCA.
  • No age bar.
  • Work Experience: 3+ years of experience in data engineering on Databricks platforms over AWS/Azure.

**Primary Skills:**

  • Direct experience of building data pipelines using Databricks Spark.
  • Building data integration with Python.
  • Hands-on experience designing and delivering solutions using the Azure Data Analytics platform.
  • Experience building data warehouse solutions using ETL/ELT tools like Informatica, Talend.
  • Comprehensive understanding of data management best practices, including demonstrated experience with data profiling, sourcing, and cleansing routines utilizing typical data quality functions involving standardization, transformation, rationalization, linking, and matching.

**Technical Skills:**

  • Must have orchestrated at least 3 projects using any of the cloud platforms (GCP, Azure, AWS etc.).
  • Must have orchestrated at least 2 projects using Databricks over AWS/Azure.
  • Must have worked on any cloud PaaS/SaaS database/DWH such as AWS redshift/ Big Query/ Snowflake.
  • Expertise in programming languages like Python or PySpark or Scala or SQL/PLSQL.
  • Python/Spark hands-on experience from a data engineering perspective is a must.
  • Experience in at least one of the major ETL tools (Talend + TAC, SSIS, Informatica) will be an added advantage.
  • Experience with GitHub and Jenkins CI/CD or similar DevOps tools.
  • Experience with ETL tooling, migrating ETL code from one technology to another will be a benefit.
  • Hands-on experience in Visualization/Dashboard tools (PowerBI, Tableau, Qliksense).

**Management Skills:**

  • Ability to handle given tasks and projects simultaneously in an organized and timely manner.
  • Daily project updates and ability to identify project risks and mitigations.

**Soft Skills:**

  • Good communication skills, verbal and written.
  • Attention to details.
  • Positive attitude and confidence.

  • Data Engineer

    2 weeks ago

    Delhi NCR, India Shamrock Value Pvt Ltd Full time

    Job Title: Data EngineerJob Summary:We are seeking a highly skilled Data Engineer to join our team at Shamrock Value Pvt Ltd. The successful candidate will be responsible for designing, building, and maintaining large-scale data pipelines and systems to support our business operations.Key Responsibilities:Design and implement scalable data pipelines to...

  • Data Engineer

    2 weeks ago

    Delhi NCR, India Shamrock Value Pvt Ltd Full time

    Job Description:Job Title: Data EngineerCompany: Shamrock Value Pvt LtdLocation: GurugramExperience: 2+ YearsSalary: Up to 15 LPA (Depends on your interview, experience and current CTC)Qualification: Master's/Bachelor's degree in Engineering, Computer Science, Math, or StatisticsAvailability: Immediate JoinersSkills:PythonSQLSparkAzure DatabricksADFDelta...

  • Data Engineer

    2 weeks ago

    Delhi NCR, India Polaris School of Technology Full time

    About UsWe are a revolutionary B2B Ed-Tech startup based out of Noida, India. Our mission is to empower educators and content creators to seamlessly transition online, offering a platform that provides live classes, storage solutions, transaction features, content monetization, and more - all in one super app.What We DoWe thrive in the post-pandemic era,...

  • Cloud Data Engineer

    5 days ago

    Delhi NCR, India Polaris School of Technology Full time

    Cloud Data EngineerWe are seeking a highly skilled Cloud Data Engineer to join our team at Polaris School of Technology. As a Cloud Data Engineer, you will play a crucial role in designing, building, and maintaining our cloud-based data systems. Your primary focus will be on ensuring the scalability, reliability, and security of our data infrastructure.Key...

  • Data Engineering Professional

    5 days ago

    Delhi NCR, India Shamrock Value Pvt Ltd Full time

    Job Title: Data EngineerAbout the Role:We are seeking a skilled Data Engineer to join our team at Shamrock Value Pvt Ltd. As a Data Engineer, you will play a crucial role in designing, building, and maintaining scalable data pipelines and ensuring data quality, enabling our organization to make informed decisions.Key Responsibilities:Data Pipeline...

  • Data Engineer

    5 months ago

    Delhi NCR, India Huquo Consulting Full time

    Position : Data EngineerLocation : GurgaonExperience : Min 4+ yearsRole & Responsibilities Overview :- A seasoned data team member with a good grasp of both business and technical aspects. - Good familiarity with data stack- Interact with the other members of the data governance team, business teams to understand requirements and also collaborate with...

  • Senior Data Engineer

    5 days ago

    Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time

    About Eucloid Data SolutionsEucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. We offer bespoke, full stack and data-driven approach to solve highly complex and large-scale business problems for some of the biggest Fortune 500...

  • Senior Data Engineer

    5 days ago

    Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time

    About the Role:Eucloid Data Solutions Pvt Ltd is seeking a highly skilled Senior Data Engineer to join our Data Platform team. The successful candidate will have hands-on expertise in Databricks and will be responsible for designing and building data infrastructure to support various business applications.Key Responsibilities:Design, implementation, and...

  • Data Engineer

    4 weeks ago

    Delhi NCR, India Shamrock Value Pvt Ltd Full time

    Job Description :Hiring : Data Engineer (Female Candidates Only)Location : GurugramExperience : 2+ YearsSalary : Up to 15 LPA(Depends on your interview, experience and current CTC)Qualification : Master's/Bachelor's degree in Engineering, Computer Science, Math, or StatisticsAvailability : Immediate JoinersSkills : Python, SQL, Spark, Azure...

  • Data Engineer

    5 days ago

    Delhi NCR, India Shamrock Value Pvt Ltd Full time

    Job Description : Hiring : Data Engineer (Female Candidates Only)Location : GurugramExperience : 2+ YearsSalary : Up to 15 LPA(Depends on your interview, experience and current CTC)Qualification : Master's/Bachelor's degree in Engineering, Computer Science, Math, or StatisticsAvailability : Immediate JoinersSkills : Python, SQL, Spark, Azure...

  • Data Engineer

    1 week ago

    Delhi NCR, India Hero Fincorp Ltd Full time

    Job Title: Data Engineer - Databricks ExpertJob Summary:We are seeking a highly skilled Data Engineer with expertise in Databricks and Spark to join our team at Hero Fincorp Ltd. As a Data Engineer, you will be responsible for designing and implementing highly performant data ingestion and transformation pipelines from multiple sources using Databricks and...

  • Senior Data Engineer

    2 weeks ago

    Gurgaon/Gurugram/Chennai/Hyderabad/Delhi NCR, India Eucloid Data Solutions Pvt Ltd Full time

    About Eucloid Data Solutions Pvt LtdEucloid Data Solutions Pvt Ltd is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Our company offers bespoke, full stack and data-driven approach to solve highly complex and large-scale business problems for some of the...

  • Senior Data Engineer

    2 weeks ago

    Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time

    About Eucloid Data SolutionsEucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning, and Data engineering. We offer a bespoke, full-stack, and data-driven approach to solve highly complex and large-scale business problems for some of the biggest Fortune 500...

  • Senior Data Engineer

    2 weeks ago

    Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time

    About Eucloid Data Solutions Pvt LtdEucloid Data Solutions Pvt Ltd is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Our company offers bespoke, full-stack and data-driven approach to solve highly complex and large-scale business problems for some of the...

  • Data Engineer

    2 weeks ago

    Delhi NCR, India Polaris School of Technology Full time

    About UsWe are a revolutionary B2B Ed-Tech startup based out of Noida, India. Our mission is to empower educators and content creators to seamlessly transition online, offering live classes, storage solutions, transaction features, content monetization, and more - all in one super app.What We DoWe thrive in the post-pandemic era, supporting a whopping 1...

  • Data Engineer

    5 days ago

    Delhi NCR, India Symbiosis Management Consultants Full time

    Data Engineering RolesWe are looking for an experienced Data Engineer to join our team at Symbiosis Management Consultants. As a data engineer, you will play a critical role in designing and implementing scalable, reliable, and maintainable data architectures. Your expertise in data integration, database management, and data modeling will enable us to make...

  • Senior Data Engineer

    5 days ago

    Gurgaon/Gurugram/Chennai/Hyderabad/Delhi NCR, India Eucloid Data Solutions Pvt Ltd Full time

    About the Role:Eucloid Data Solutions Pvt Ltd is seeking a seasoned Data Engineer with expertise in Databricks to join our Data Platform team. As a vital member of our team, you will play a key role in developing data infrastructure on Databricks for our clients.Key Responsibilities:Design, implementation, and improvement of data pipelines for reliability...

  • Data Engineer

    5 days ago

    Delhi NCR, India Grip Invest Full time

    About the RoleWe are seeking a highly skilled Data Scientist to join our team at Grip Invest. As a Data Scientist, you will play a key role in driving business growth through data-driven insights and strategic recommendations.Key Responsibilities- Support business decision-making by analyzing and interpreting large datasets to identify trends and patterns-...

  • Senior Data Engineer

    4 weeks ago

    Delhi NCR, India Symbiosis Management Consultants Full time

    Roles & Responsibilities : - Data Architecture Design : Design and implement scalable, reliable, and maintainable data architectures.- Data Integration : Develop ETL processes to integrate data from various sources into a centralized data warehouse. Ensure data quality and integrity throughout the integration process.- Database Management : Administer and...

  • Data Engineer

    2 weeks ago

    Gurgaon/Gurugram/Delhi NCR, India InstaTalent Recruit LLP Full time

    Job Title: Data EngineerInsta Talent Reruit LLP, a leading company in the tech industry, is seeking a skilled Data Engineer to join our dynamic team.Job SummaryWe are looking for a highly experienced Data Engineer to design, develop, and implement scalable, automated processes for data extraction, processing, and analysis in a Data Mesh architecture.Key...