Data Engineer

3 weeks ago


Mumbai, Maharashtra, India Huquo Full time

Position : Data Engineer

Location : Mumbai

Experience : 4-6 Years

Clairvoyant is a global technology consulting and services company founded in 2012, headquartered in Chandler, US, and have delivery centers across the globe. We help organizations maximize the value of data by providing data engineering, analytics, machine learning, and user experience consulting and development projects to multiple Fortune 500 clients. Clairvoyant clients rely on its deep vertical knowledge and best-in-class services to drive revenue growth, boost operational efficiencies, and manage risk and compliance. Our team of experts with direct industry experience in data engineering, analytics, machine learning, and user experience has your back every step of the way.

"Our Values: Passion, Continuous Learning, Adaptability, Teamwork, Customer Centricity, Reliability"

Role & Responsibilities :

- 4+ years of hands-on experience in SQL, PySpark & Python, should be experienced in shell scripting

- Experienced with AWS services (S3, Glue, Lambda, EMR, Boto3 etc.), Apache Airflow, ETL, Data Warehousing

- Experienced implementing ETL pipelines & and migration requirements

- Sound knowledge of Data Engineering concepts and tools for Data Ingestion, Integration and workflow orchestration

- Ability to handle augmentation of both structured, unstructured, and real-time data, and provide best practices for pipeline operations

- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability

- Troubleshoot and remediate data quality issues raised by pipeline alerts or downstream consumers. Implement Data Governance best practices.

- Create and maintain clear documentation on data models/schemas as well as transformation/validation rules

- Implement tools that help data consumers to extract, analyze, and visualize data faster through data pipelines

- Led the entire software lifecycle including hands-on development, code reviews, testing, deployment, and documentation for batch ETLs.

- Migrate current on-premise data applications and pipelines to the Cloud leveraging technologies in the future

Good to have : Apache Kafka skills

Education :

Bachelor's degree in Computer Science, Software Engineering, MIS or equivalent combination of education and experience

(ref:hirist.tech)

  • Navi Mumbai, Maharashtra, India timesjobs Full time

    JOB DETAILSHighly proficient working with Scala/Java or PythonComfort working with large data sets and high-velocity data streamsHighly experience at data storage and processing (e.g. Kafka, Flink, Spark)Good relational and NoSQL database working knowledgeAn interest in healthcare and medical sectorsTechnical degree with 5 plus years backend data-heavy...


  • Mumbai, Maharashtra, India Cornerstone OnDemand Full time

    We are seeking a Senior DataEngineer with expertise in Looker and Google Cloud Platform (GCP) to join ourinnovative team. With at least 10 years of overall experience in dataengineering, including a minimum of 5 years working with Looker and GCP, theideal candidate will lead the design, development, and maintenance of LookMLmodels and dashboards. This role...

  • Team Lead

    3 weeks ago


    Mumbai, Maharashtra, India WIZSTAFFING PRIVATE LIMITED Full time

    Job Description :- We are seeking a highly skilled and motivated individual to join our team as a team lead - azure data engineer.- The ideal candidate will have a strong background in azure data technologies, a proven track record of leading data engineering teams, and the ability to design and implement scalable and efficient data solutions.- The team lead...


  • Mumbai, Maharashtra, India Mondelez india foods private limited Full time

    More about this role :In this role, you will have the opportunity to work on the development of a cutting-edge solution that aims to automate commercial reporting and insights to standardize business performance across the organization. You will play an instrumental part in shaping and engineering the features of this solution in daily operations.What you...

  • Data Engineer

    3 weeks ago


    Mumbai, Maharashtra, India Versor Investments Full time

    Job Description :The Data Engineer position will be based in Mumbai and be part of the Portfolio Analytics team. He / She will collaborate closely with senior researchers to design and develop a large-scale data lake. We are seeking candidates who have excelled in engineering specifically computer science. Prior experience in investments and finance is...

  • RBHU Analytics

    3 weeks ago


    Mumbai, Maharashtra, India RBHU ETG Private Limited Full time

    Responsibilities :1. Assume ownership of Data Engineering projects from inception to completion.2. Implement fully operational data warehouse solutions in production environments using Snowflake.3. Showcase proficiency in Snowflake data modelling and ELT techniques with Snowflake SQL, including the implementation of complex stored procedures and adherence to...


  • Mumbai/Navi Mumbai, Maharashtra, India Looper Development Services Private Limited Full time

    Job Description :- Bachelor's or advanced degree in Computer Science, Information Technology, or related field.- Proven experience as a Back-End Data Engineer or similar role.- Proficiency in database design and management (e.g., SQL, NoSQL).- Strong programming skills in languages such as Python, Java, or Scala.- Experience with ETL tools and data...

  • Data Engineer

    3 weeks ago


    Mumbai, Maharashtra, India Huquo Full time

    As Data Engineer, your specific responsibilities include the following :- Create and maintain optimal data pipeline architecture- Assemble large, complex data sets that meet functional / non-functional business requirements- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing...


  • Mumbai, Maharashtra, India RBHU ETG Private Limited Full time

    Responsibilities :1. Assume ownership of Data Engineering projects from inception to completion.2. Implement fully operational data lakehouse solutions in production environments using Databricks.3. Showcase proficiency in Pyspark based data modelling and transformation4. Extract and model data from sources like XML, CSV, txt and other file formats and store...


  • Mumbai, Maharashtra, India Freelancer Full time

    Job Description :We're hiring for one of our clients that is based out in Mumbai (Andheri East) and is a UK based world's leading venture builder company in digital product space in FinTech, EdTech, Govt.Tech, Media, Sports and more!It is driven by a mission to empower visionaries to lead, innovate, and build disruptive solutions to support their...


  • Mumbai, Maharashtra, India DHANI Full time

    Roles & Responsibilities :We are looking for a Data Engineer to join our Campaign Analytics team. The Campaign Analytics suite of products utilize survey based datasets to measure, analyze, and report on Advertisement effectiveness.As a Data Engineer, you will work alongside data scientists and engineers, to build a data platform on AWS to ingest data from...

  • Data Engineer II

    6 days ago


    Bangalore/Mumbai, Maharashtra, India Xaltworks Consulting Full time

    Job Requirement : What you'll do :- Lead and manage a team of data engineers, providing guidance, mentorship, and support- Collaborate with data scientists and analysts to understand their data needs and develop data solutions that meet those needs- Design, build, and maintain scalable data platforms and pipelines to support the needs of the business-...


  • Mumbai, Maharashtra, India Olive Trees Consulting Full time

    Job Description :- Our IT client based in Malad, Mumbai is looking for a Data Mesh Engineer. The main purpose of the role is to design, build, and maintain data pipelines and infrastructure using Microsoft Fabric components. You'll play a crucial role in enabling data mesh architecture within the organization, ensuring scalability, reliability, and...


  • Mumbai, Maharashtra, India Ernst and Young Services Pvt. Ltd Full time

    Azure ETL Engineer/ Data Warehouse Engineer:Position Description: The Azure ETL Engineer will perform hands-on ETL/ELT pipeline development to support a long-term initiative to migrate and transform an existing on-premises Data Management and Analytics solution to Azure.The Azure ETL Engineer will work under the direction of a Team Lead BI Architect to...


  • Thane/Mumbai, Maharashtra, India AMSYS IT Services Pvt Ltd Full time

    Job Summary : - We are seeking a skilled and experienced Data Backup Engineer to join our dynamic team.- The Data Backup Engineer will be responsible for implementing and maintaining data backup systems, ensuring the security and integrity of our organization's data.- The ideal candidate should have a strong understanding of backup technologies, data...

  • Lead Data Engineer

    3 weeks ago


    Mumbai, Maharashtra, India Sampoorna Consultants Pvt. Ltd Full time

    Client is looking out for a technical delivery leader on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions.The role will drive the development of data processing frameworks and architectural approaches that scale to handle the business's...

  • Lead Data Engineer

    3 weeks ago


    Mumbai/Pune/Maharashtra/Navi Mumbai, Maharashtra, India xl advisors Full time

    About us:JSW One Platforms is a venture founded by the world-renowned JSW group. JSW One is our integrated technology platform that seeks to transform India through increased transparency, trust, and ease-of-business. The JSW One Platforms are home to JSW One MSME and JSW One Homes. JSW One MSME, is a one-stop, multi-product digital marketplace, for MSMEs...

  • Data Engineer

    2 weeks ago


    Mumbai, Maharashtra, India timesjobs Full time

    Please share your resume at ruchita.-Experience: 4 YearsLocation : MumbaiJob Description:4 years (must) relavent experience in Bigdata and cloud technologies with can do attitudeBig data tools: Spark etc.Relational SQL and NoSQL databases.Data pipeline and workflow management tools: Azure Data Factory, Airflow, etc.Azure cloud services: Data lake,...

  • Data Engineer

    5 days ago


    Bangalore/Mumbai, Maharashtra, India Neer Info Full time

    About the job : - The ideal candidate will be responsible for conceptualizing and executing clear, quality code to develop the best software.- You will test your code, identify errors, and iterate to ensure quality code.- You will also support our customers and partners by troubleshooting any of their software issues.Project Role : Data Engineer- Project...


  • Thane/Mumbai/Navi Mumbai, Maharashtra, India Ventura Securities Ltd. Full time

    Job description :About us :Ventura Securities is establishing its fintech team - a hybrid work environment with highly talented individuals who come from diverse backgrounds and looking to solve real client problems at scale. Ventura has been in the stock broking business for 25+ years and it is a robust and profitable franchise with 1000+ employees...