Data Engineer

4 weeks ago

Delhi, India Luminary Talent Sourcing Full time
Job DescriptionAbout the Role:

We are seeking a highly skilled and experienced Senior Data Engineer / Architect to join our team and lead the design and development of a real-time analytics platform. The successful candidate will be part of a team responsible for architecture, designing, and building the data infrastructure and pipelines to enable real-time data streaming, transformation, and visualization. This is an exciting opportunity to work on cutting-edge technologies and make a significant impact on our analytics capabilities.

Key Responsibilities:

Design and implement scalable and fault-tolerant data streaming and ingestion pipelines using Apache Kafka.

Architect and develop a cloud-based data warehousing solution using technologies using such as Apache Hadoop HDFS, Snowflake. Apache Hive or similar technologies for the storage and analysis of structured and unstructured data.

Lead the development of data transformation and modeling processes using

DBT, Apache Spark, Apache Beam or similar technologies.

Lead design and implementation of Reporting / Visualization efforts using Apache Superset, Apache Zeppelin, Metabase, Looker or similar technologies.

Collaborate with front-end developers to embed interactive dashboards and reports using Apache Superset or similar tools into a React front-end.

Ensure data security, governance, and compliance requirements are met by implementing access controls and auditing mechanisms using Apache Ranger, or Apache Sentry or similar technologies.

Mentor and guide junior team members, provide technical leadership, and contribute to the overall technical strategy and roadmap for the analytics platform.

KINDLY TAKE NOTE THAT THE RECRUITMENT AND SELECTION PROCESS WILL INVOLVE

PSYCHOMETRIC ASSESSMENTS.

Requirements

Required Skills and Experience:

Experience in building real-time analytics platforms.

9+ Experience in data engineering and data architecture, with a focus on a cloud-based data warehousing solutions around structured (dimensional models) and unstructured data.

Proficiency in Apache Kafka for data streaming and ingestion.

Experience with cloud-based data warehousing solutions such as Apache Hadoop HDFS, Snowflake, Amazon Redshift, Amazon S3, or Google Cloud Storage.

Proficiency in the programming languages as relevant for the platforms involved, such as Java, SQL, Python, or Scala.

Hands-on experience with Apache Spark or Apache Beam for large-scale data processing and transformation.

Experience with data visualization and exploration tools such as Apache Superset, Apache Zeppelin, Metabase, Looker or similar platforms.

Familiarity with security and governance tools and practices in the Hadoop ecosystem, such as Apache Ranger or Apache Sentry.

Excellent communication skills and the ability to work effectively in a collaborative team environment.

Bachelor's or Master's degree in Computer Science, Engineering, or a related field if preferred but not mandatory.

  • Operations Specialist

    2 weeks ago

    Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Operations Specialist

    2 weeks ago

    Delhi, Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Snowflake Data Engineer

    2 weeks ago

    Delhi, Delhi, India Lapis Data Analytics Full time

    Company DescriptionLapis Data Analytics is a dynamic and innovative data engineering company founded in 2020 and located in Chennai. Our primary focus is on designing, building, and maintaining robust data pipelines that convert raw data into actionable insights. With a team of seasoned experts and cutting-edge technology, we deliver customized data...

  • Digital Engineering Sr. Engineer

    2 weeks ago

    Delhi, Delhi, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...

  • Digital Engineering Sr. Engineer

    2 weeks ago

    Delhi, Delhi, India NTT DATA Full time

    Job DescriptionReq ID:273690NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...

  • Lead Data Engineer

    7 days ago

    Delhi, India Advance Data Analytics Ltd. Full time

    *Immediate Joiners Preferred* We are hiring for a UK based client Experience: 6 to 10 years Location: Noida (Hybrid) Your main duties & responsibilities: Design, build and unit test of aspects data services, from ingestion, through harmonization and transformation into business usable analytics. Input into High level design and responsibility for low level...

  • Lead Data Engineer

    7 days ago

    Delhi, India Advance Data Analytics Ltd. Full time

    *Immediate Joiners Preferred*We are hiring for a UK based clientExperience: 6 to 10 yearsLocation: Noida (Hybrid)Your main duties & responsibilities:Design, build and unit test of aspects data services, from ingestion, through harmonization and transformation into business usable analytics.Input into High level design and responsibility for low level...

  • Digital Engineering Sr. Engineer

    2 weeks ago

    Delhi, Delhi, India NTT DATA Services Full time

    Req ID:273690NTT DATA Services is looking for a Digital Engineering Sr. Engineer to join their team in Delhi, India.Responsibilities: Manage and maintain the Appworx/UC4 batch scheduling system Create and modify job schedules as required Monitor job execution and ensure accuracy and timeliness Troubleshoot any issues during job execution Collaborate with...

  • Tableau Developer

    2 weeks ago

    delhi, India The Data Family Full time

    Company DescriptionThe Data Family offers analytics and data visualization services designed to transform data into actionable insights for our clients. Through our service, customers can access expert analytics, robust data engineering, and captivating visualizations to drive better decision-making and uncover opportunities for growth.Our primary customers...

  • Software Engineer

    2 weeks ago

    Delhi, Delhi, India NTT DATA Full time

    Job DescriptionReq ID:283993NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Software Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Work closely with the...

  • Data Engineer

    1 week ago

    Delhi, India krtrimaIQ Cognitive Solutions Full time

    Company DescriptionkrtrimaIQ Cognitive Solutions is a technology company specializing in Cognitive Process Automation, Data Engineering, Statistical Analysis and Optimization, Data Science, Natural Language Processing, and Computer Vision. Our expertise allows us to transform organizations into intelligent enterprises.Role DescriptionThis is a full-time...

  • Digital Engineering Sr. Engineer

    4 weeks ago

    New Delhi, India NTT DATA Full time

    Job DescriptionReq ID:273690NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Sr. Engineer to join our team in Delhi, Delhi (IN-DL), India...

  • Data Engineer

    2 weeks ago

    Delhi, Delhi, India Aprisity Technologies Full time

    We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals.To succeed in this data engineering position, you should have...

  • Data Engineer

    2 weeks ago

    Delhi, India Lingaro Full time

    Role: Data Engineer – Lead ConsultantLocation: IndiaAbout Lingaro:Lingaro Group is the end-to-end data services partner to global brands and enterprises. We lead our clients through their data journey, from strategy through development to operations and adoption, helping them to realize the full value of their data.Since 2008, Lingaro has been recognized...

  • Software Engineer

    2 weeks ago

    Delhi, Delhi, India NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Software Engineer to join our team in Delhi, Delhi (IN-DL), India (IN).Work closely with the Senior...

  • Data Engineer

    2 weeks ago

    delhi, India Lingaro Full time

    Role: Data Engineer – Lead ConsultantLocation: IndiaAbout Lingaro:Lingaro Group is the end-to-end data services partner to global brands and enterprises. We lead our clients through their data journey, from strategy through development to operations and adoption, helping them to realize the full value of their data.Since 2008, Lingaro has been recognized...

  • Data Engineer

    7 days ago

    Delhi, India Innovalus Full time

    Data EngineerJob DescriptionThe Data Engineer provides core knowledge in data integration techniques to build complex data-centric solutions. This role's focus is on the design, implementation, automation, and optimisation of data pipelines and enterprise-wide data-centric applications (e.g., data lakes, data warehouses) for large and/or challenging data...

  • Data Engineer

    2 weeks ago

    Delhi, Delhi, India Aprisity Technologies Full time

    We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. To succeed in this data engineering position, you should have...

  • Data Engineer

    2 weeks ago

    Delhi, Delhi, India Edstem Technologies Full time

    Data Engineer (AI – Based Product Development)Roles: We are looking for Data Engineers for an AI based product development for one of our clients in the banking industry. As a data engineer you will play a pivotal role in collaborating with a team of skilled data engineers to develop and operationalize machine learning models that drive customer...

  • Data Engineer

    2 weeks ago

    Delhi, Delhi, India Evive | goevive Full time

    We're looking for a thorough Data Engineer. Is it you?The Data Engineer designs and builds the data pipelines that will enable faster and more accurate data-informed recommendations and decisions both inside and outside of the Evive platform. On a daily basis they design and build services to collect, compile, normalize, and analyze data assets coming from...