Data Engineer

1 day ago

bangalore, India Dautom Full time

Data Engineer (Big Data, Hadoop, Spark)Location: Offshore - India (Remote)Contract Duration: 6 Months (Renewable)Client Industry: Banking/Financial ServicesEmployment Type: Contract (Payroll: Dautom IT Consultants LLC)Notice Period: 30 days or lessExperience: 6-10+ years of proven experience as a Big Data Engineer.Application Note:Independent contractors with their own firms are not encouraged to apply for this role.About the Role:We are seeking a highly experienced Senior Data Engineer with 7-10 years of deep expertise in the Big Data ecosystem. The ideal candidate will be a hands-on technical leader, proficient in designing, building, and tuning large-scale distributed data systems. This role involves leading a team of data engineers while owning key deliverables and ensuring the integrity and performance of our data platforms.Key Responsibilities:Technical Leadership & Hands-On Development:Lead and mentor a backend/distributed data systems team while remaining hands-on with code and architecture.Own end-to-end deliverables for the Big Data team from a delivery perspective.Write, tune, and optimize complex Java, MapReduce, Hive, and Spark jobs.Design and build scalable dimensional data models to improve data accessibility, efficiency, and quality.Big Data Engineering:Utilize the Hadoop stack extensively (HDFS, MapReduce, Pig, Hive, HBase, Flume, Sqoop).Develop and maintain solutions using NoSQL stores like Cassandra and HBase.Build and manage data pipelines using stream-processing frameworks such as Spark-Streaming.Data Management & BI:Manage the business intelligence team and vendor partners, prioritizing projects based on business needs.Develop high-quality dashboards using industry best practices.Analyze and confirm the integrity of source data.Lead the deployment and auditing of data models for accuracy.Team & Vendor Management:Manage a team of data engineers, including full-time associates and third-party resources.Foster a cooperative work environment and assist team members in achieving group goals.Required Skills & Qualifications:Experience: 6-10+ years of proven experience as a Big Data Engineer.Big Data Frameworks: In-depth knowledge of Hadoop (Cloudera distribution preferred), Spark, and similar frameworks.Big Data Tools: Proficiency with Big Data querying tools like Pig, Hive, and Impala.Programming Languages: Strong skills in Java and object-oriented/function scripting languages like Python or Scala.Database Expertise:Advanced SQL skills with expertise in performance tuning.Experience with relational SQL (e.g., Postgres) and NoSQL databases (e.g., Cassandra).Data Modeling: Experience in designing and building dimensional data models.Stream Processing: Hands-on experience with stream-processing systems (e.g., Spark-Streaming, Storm).Desired Skills (Pluses):Experience with Azure cloud services.Knowledge of the Banking/Financial Services industry.Familiarity with data science and machine learning tools and technologies.Knowledge of other scripting languages like C++, Linux, Ruby, PHP, or R.Personal Attributes:Excellent problem-solving skills for complex networking, data, and software issues.Ability to effectively plan, organize, and prioritize work.Strong interpersonal and communication skills.A collaborative team player who builds and maintains positive work relationships.

  • Data Engineer

    3 days ago

    bangalore, India Data-Hat AI Full time

    Department: Data Engineering & AI Solutions Reports To: Lead Data Solutions Architect Travel: International travel required (up to 30–40%)  Position Summary: We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 324638NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Bangalore Karnxc4x81taka IN-KA India IN Key Responsibilities Design and implement...

  • Senior/Lead Data Engineer

    3 days ago

    bangalore, India Eucloid Data Solutions Full time

    About The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to designing...

  • Sr. Data Science

    1 week ago

    Bangalore, India NTT DATA Full time

    Job Description Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Science & AIML, GenAI Lead/Engineer to join our team in Bangalore, Karnātaka (IN-KA), India...

  • Data Senior Engineer

    3 weeks ago

    HAL Bangalore Airport, India NTT DATA North America Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience in a...

  • Data Engineer

    3 weeks ago

    HAL Bangalore Airport, India NTT DATA North America Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key Responsibilities Data...

  • Data Engineer

    3 weeks ago

    HAL Bangalore Airport, India NTT DATA North America Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Lead Data Architect

    5 days ago

    Bangalore, Karnataka, India NTT DATA Full time

    NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Lead Data Architect to join our team in Bangalore Karnxc4x81taka IN-KA India IN Position Overview We are seeking a highly...

  • Applied & Data Scientist

    1 week ago

    Bangalore, India Anicca Data Science Solutions Full time

    Role Overview We are seeking a  Senior Data Scientist with strong expertise in applied data science and machine learning. The role involves designing, developing, and deploying advanced models, building dashboards, and collaborating cross-functionally to deliver data-driven solutions that solve real-world business challenges. Key Responsibilities ...

  • Azure Data Migration

    2 weeks ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 317094NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Azure Data Migration to join our team in Bangalore Karnxc4x81taka IN-KA India IN Job Duties Primary Responsibility...