Data Engineer

4 weeks ago


BangaloreMumbai, Maharashtra, India Cyitechsearch Full time

Job Description :


- Minimum experience 4 to 11 years.

Locations : Bangalore & Mumbai.

Max Notice Period : 45 Days.

Job Overview :

The role of Data Engineer involves leading complex business reengineering development projects and solving organizational problems through IT solutions using Big Data concepts, Platform tools, and software engineering languages as required.

Key Responsibilities include :

- Designing, developing and implementing solutions to customers organizational problems

- Providing high-quality service delivery on engagements

- Designing and developing data reconciliation & metadata-driven data processing frameworks

Responsibilities and Duties :

Key Skills/Experience :

- Working experience and strong knowledge in Databricks.

- Knowledge in Cloud Computing - AWS preferably.

- Knowledge in Data warehousing (SCD).

- Knowledge in programming and shell scripting eg. Core/Python/Scala/Java.

- Knowledge in SQL.

- Knowledge with Github and Jenkins

- Knowledge on change data capture in a big data ecosystem

- Knowledge building real time or batch ingestion and transformation pipelines

Additional skills/responsibilities of this role :

- Knowledge on supporting a production service in a DevOps friendly environment

- Knowledge on working in Agile/Scrum teams

- Knowledge on API and cloud-native architecture


- Knowledge on with 'container' technology (e.g.Docker, Kubernetes)

- Knowledge on wrangling data using library such as Pandas, Scikit-learn or Numpy

- Knowledge on using notebook such as Jupyter or Polyglot

- Knowledge on test-driven development, test automation & continuous delivery

The following qualifications would be advantageous :

Education level : Degree in Computer Science, Information Systems or related field.

- Databricks Associate certification and AWS certification would be advantageous.

- Understanding of Financial Services Industry could be advantageous.

(ref:hirist.tech)
  • Data Engineer II

    1 week ago


    Bangalore/Mumbai, Maharashtra, India Xaltworks Consulting Full time

    Job Requirement : What you'll do :- Lead and manage a team of data engineers, providing guidance, mentorship, and support- Collaborate with data scientists and analysts to understand their data needs and develop data solutions that meet those needs- Design, build, and maintain scalable data platforms and pipelines to support the needs of the business-...

  • Data Engineer

    7 days ago


    Bangalore/Mumbai, Maharashtra, India Neer Info Full time

    About the job : - The ideal candidate will be responsible for conceptualizing and executing clear, quality code to develop the best software.- You will test your code, identify errors, and iterate to ensure quality code.- You will also support our customers and partners by troubleshooting any of their software issues.Project Role : Data Engineer- Project...


  • Mumbai/Bangalore, Maharashtra, India Techno Wise Full time

    Responsibilities :1. Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and PySpark.2. Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that align with business needs.3. Optimize and tune existing data pipelines for performance and...

  • Data Engineer

    4 weeks ago


    Mumbai, Maharashtra, India Huquo Full time

    Position : Data EngineerLocation : MumbaiExperience : 4-6 YearsClairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience...


  • Navi Mumbai, Maharashtra, India timesjobs Full time

    JOB DETAILSHighly proficient working with Scala/Java or PythonComfort working with large data sets and high-velocity data streamsHighly experience at data storage and processing (e.g. Kafka, Flink, Spark)Good relational and NoSQL database working knowledgeAn interest in healthcare and medical sectorsTechnical degree with 5 plus years backend data-heavy...


  • Mumbai, Maharashtra, India Cornerstone OnDemand Full time

    We are seeking a Senior DataEngineer with expertise in Looker and Google Cloud Platform (GCP) to join ourinnovative team. With at least 10 years of overall experience in dataengineering, including a minimum of 5 years working with Looker and GCP, theideal candidate will lead the design, development, and maintenance of LookMLmodels and dashboards. This role...

  • Team Lead

    4 weeks ago


    Mumbai, Maharashtra, India WIZSTAFFING PRIVATE LIMITED Full time

    Job Description :- We are seeking a highly skilled and motivated individual to join our team as a team lead - azure data engineer.- The ideal candidate will have a strong background in azure data technologies, a proven track record of leading data engineering teams, and the ability to design and implement scalable and efficient data solutions.- The team lead...


  • Mumbai, Maharashtra, India Mondelez india foods private limited Full time

    More about this role :In this role, you will have the opportunity to work on the development of a cutting-edge solution that aims to automate commercial reporting and insights to standardize business performance across the organization. You will play an instrumental part in shaping and engineering the features of this solution in daily operations.What you...

  • Data Engineer

    4 weeks ago


    Mumbai, Maharashtra, India Versor Investments Full time

    Job Description :The Data Engineer position will be based in Mumbai and be part of the Portfolio Analytics team. He / She will collaborate closely with senior researchers to design and develop a large-scale data lake. We are seeking candidates who have excelled in engineering specifically computer science. Prior experience in investments and finance is...

  • RBHU Analytics

    3 weeks ago


    Mumbai, Maharashtra, India RBHU ETG Private Limited Full time

    Responsibilities :1. Assume ownership of Data Engineering projects from inception to completion.2. Implement fully operational data warehouse solutions in production environments using Snowflake.3. Showcase proficiency in Snowflake data modelling and ELT techniques with Snowflake SQL, including the implementation of complex stored procedures and adherence to...


  • Mumbai/Navi Mumbai, Maharashtra, India Looper Development Services Private Limited Full time

    Job Description :- Bachelor's or advanced degree in Computer Science, Information Technology, or related field.- Proven experience as a Back-End Data Engineer or similar role.- Proficiency in database design and management (e.g., SQL, NoSQL).- Strong programming skills in languages such as Python, Java, or Scala.- Experience with ETL tools and data...

  • Data Engineer

    4 weeks ago


    Mumbai, Maharashtra, India Huquo Full time

    As Data Engineer, your specific responsibilities include the following :- Create and maintain optimal data pipeline architecture- Assemble large, complex data sets that meet functional / non-functional business requirements- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing...


  • Mumbai, Maharashtra, India RBHU ETG Private Limited Full time

    Responsibilities :1. Assume ownership of Data Engineering projects from inception to completion.2. Implement fully operational data lakehouse solutions in production environments using Databricks.3. Showcase proficiency in Pyspark based data modelling and transformation4. Extract and model data from sources like XML, CSV, txt and other file formats and store...


  • Mumbai, Maharashtra, India Freelancer Full time

    Job Description :We're hiring for one of our clients that is based out in Mumbai (Andheri East) and is a UK based world's leading venture builder company in digital product space in FinTech, EdTech, Govt.Tech, Media, Sports and more!It is driven by a mission to empower visionaries to lead, innovate, and build disruptive solutions to support their...


  • Mumbai, Maharashtra, India DHANI Full time

    Roles & Responsibilities :We are looking for a Data Engineer to join our Campaign Analytics team. The Campaign Analytics suite of products utilize survey based datasets to measure, analyze, and report on Advertisement effectiveness.As a Data Engineer, you will work alongside data scientists and engineers, to build a data platform on AWS to ingest data from...


  • Mumbai, Maharashtra, India Olive Trees Consulting Full time

    Job Description :- Our IT client based in Malad, Mumbai is looking for a Data Mesh Engineer. The main purpose of the role is to design, build, and maintain data pipelines and infrastructure using Microsoft Fabric components. You'll play a crucial role in enabling data mesh architecture within the organization, ensuring scalability, reliability, and...


  • Mumbai, Maharashtra, India Ernst and Young Services Pvt. Ltd Full time

    Azure ETL Engineer/ Data Warehouse Engineer:Position Description: The Azure ETL Engineer will perform hands-on ETL/ELT pipeline development to support a long-term initiative to migrate and transform an existing on-premises Data Management and Analytics solution to Azure.The Azure ETL Engineer will work under the direction of a Team Lead BI Architect to...


  • Thane/Mumbai, Maharashtra, India AMSYS IT Services Pvt Ltd Full time

    Job Summary : - We are seeking a skilled and experienced Data Backup Engineer to join our dynamic team.- The Data Backup Engineer will be responsible for implementing and maintaining data backup systems, ensuring the security and integrity of our organization's data.- The ideal candidate should have a strong understanding of backup technologies, data...

  • Lead Data Engineer

    4 weeks ago


    Mumbai, Maharashtra, India Sampoorna Consultants Pvt. Ltd Full time

    Client is looking out for a technical delivery leader on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions.The role will drive the development of data processing frameworks and architectural approaches that scale to handle the business's...

  • Lead Data Engineer

    4 weeks ago


    Mumbai/Pune/Maharashtra/Navi Mumbai, Maharashtra, India xl advisors Full time

    About us:JSW One Platforms is a venture founded by the world-renowned JSW group. JSW One is our integrated technology platform that seeks to transform India through increased transparency, trust, and ease-of-business. The JSW One Platforms are home to JSW One MSME and JSW One Homes. JSW One MSME, is a one-stop, multi-product digital marketplace, for MSMEs...