Data Engineer

4 weeks ago

Delhi, India Dautom Full time

Data Engineer (Big Data, Hadoop, Spark) Location: Offshore - India (Remote) Contract Duration: 6 Months (Renewable) Client Industry: Banking/Financial Services Employment Type: Contract (Payroll: Dautom IT Consultants LLC) Notice Period: 30 days or less Experience: 6-10+ years of proven experience as a Big Data Engineer. Application Note: Independent contractors with their own firms are not encouraged to apply for this role. About the Role: We are seeking a highly experienced Senior Data Engineer with 7-10 years of deep expertise in the Big Data ecosystem. The ideal candidate will be a hands-on technical leader, proficient in designing, building, and tuning large-scale distributed data systems. This role involves leading a team of data engineers while owning key deliverables and ensuring the integrity and performance of our data platforms. Key Responsibilities: - Technical Leadership & Hands-On Development: - Lead and mentor a backend/distributed data systems team while remaining hands-on with code and architecture. - Own end-to-end deliverables for the Big Data team from a delivery perspective. - Write, tune, and optimize complex Java, MapReduce, Hive, and Spark jobs. - Design and build scalable dimensional data models to improve data accessibility, efficiency, and quality. - Big Data Engineering: - Utilize the Hadoop stack extensively (HDFS, MapReduce, Pig, Hive, HBase, Flume, Sqoop). - Develop and maintain solutions using NoSQL stores like Cassandra and HBase. - Build and manage data pipelines using stream-processing frameworks such as Spark-Streaming. - Data Management & BI: - Manage the business intelligence team and vendor partners, prioritizing projects based on business needs. - Develop high-quality dashboards using industry best practices. - Analyze and confirm the integrity of source data. - Lead the deployment and auditing of data models for accuracy. - Team & Vendor Management: - Manage a team of data engineers, including full-time associates and third-party resources. - Foster a cooperative work environment and assist team members in achieving group goals. Required Skills & Qualifications: - Experience: 6-10+ years of proven experience as a Big Data Engineer. - Big Data Frameworks: In-depth knowledge of Hadoop (Cloudera distribution preferred), Spark, and similar frameworks. - Big Data Tools: Proficiency with Big Data querying tools like Pig, Hive, and Impala. - Programming Languages: Strong skills in Java and object-oriented/function scripting languages like Python or Scala. - Database Expertise: - Advanced SQL skills with expertise in performance tuning. - Experience with relational SQL (e.g., Postgres) and NoSQL databases (e.g., Cassandra). - Data Modeling: Experience in designing and building dimensional data models. - Stream Processing: Hands-on experience with stream-processing systems (e.g., Spark-Streaming, Storm). Desired Skills (Pluses): - Experience with Azure cloud services. - Knowledge of the Banking/Financial Services industry. - Familiarity with data science and machine learning tools and technologies. - Knowledge of other scripting languages like C++, Linux, Ruby, PHP, or R. Personal Attributes: - Excellent problem-solving skills for complex networking, data, and software issues. - Ability to effectively plan, organize, and prioritize work. - Strong interpersonal and communication skills. - A collaborative team player who builds and maintains positive work relationships.

  • Data Engineer

    4 weeks ago

    Delhi, India Data-Hat AI Full time

    Department: Data Engineering & AI SolutionsReports To: Lead Data Solutions ArchitectTravel: International travel required (up to 30–40%)Position Summary:We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data engineer

    4 weeks ago

    Delhi, India Data-Hat AI Full time

    Department: Data Engineering & AI Solutions  Reports To: Lead Data Solutions ArchitectTravel: International travel required (up to 30–40%)Position Summary:  We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data Engineer

    4 weeks ago

    Delhi, India Data-Hat AI Full time

    Department:Data Engineering & AI SolutionsReports To:Lead Data Solutions ArchitectTravel:International travel required (up to 30–40%)Position Summary:We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructurethat underpins mission-critical AI systems. With 12+ years of experience,...

  • Senior/Lead Data Engineer

    4 weeks ago

    Delhi, India Eucloid Data Solutions Full time

    About The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to designing...

  • Senior Data Engineer

    3 weeks ago

    New Delhi, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Senior Data Engineer

    3 weeks ago

    New Delhi, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Senior Data Engineer

    2 weeks ago

    Delhi, NCR, India MchooversPacific Data Integrators Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Title: Senior Data Engineer (IDMC-CDI)Primary Skills: IDMC (CDI), ETL ConceptsMode of Work: Remote/WFHExperience: 8-15 yearsShift Timing: Open to work in EST shift (5PM to 2AM IST)About UsWe are PDI (Pacific Data Integrators), a leading provider of Data Management, Analytics, and Cloud solutions. As an Informatica Platinum Partner and a reseller of various...

  • Senior Data Scientist

    1 week ago

    New Delhi, India Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 7 yearsLocation: ChennaiWhy Crayon? Why now?Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...

  • Senior Data Scientist

    1 week ago

    New Delhi, India Crayon Data Full time

    Role:Sr Data Scientist Experience level:5 to 7 years Location:ChennaiWhy Crayon? Why now? Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...

  • Data Analytics Lead

    3 days ago

    Delhi, India NTT Data Full time

    Job Description NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Analytics Lead to join our team in Delhi, Delhi (IN-DL), India (IN). Experience: 8+ Years Location: Delhi NCR...