Data Engineer

4 weeks ago

Surat, India Dautom Full time

Data Engineer (Big Data, Hadoop, Spark)


Location: Offshore - India (Remote)

Contract Duration: 6 Months (Renewable)

Client Industry: Banking/Financial Services

Employment Type: Contract (Payroll: Dautom IT Consultants LLC)

Notice Period: 30 days or less

Experience: 6-10+ years of proven experience as a Big Data Engineer.


Application Note:

Independent contractors with their own firms are not encouraged to apply for this role.


About the Role:

We are seeking a highly experienced Senior Data Engineer with 7-10 years of deep expertise in the Big Data ecosystem. The ideal candidate will be a hands-on technical leader, proficient in designing, building, and tuning large-scale distributed data systems. This role involves leading a team of data engineers while owning key deliverables and ensuring the integrity and performance of our data platforms.


Key Responsibilities:

  • Technical Leadership & Hands-On Development:
  • Lead and mentor a backend/distributed data systems team while remaining hands-on with code and architecture.
  • Own end-to-end deliverables for the Big Data team from a delivery perspective.
  • Write, tune, and optimize complex Java, MapReduce, Hive, and Spark jobs.
  • Design and build scalable dimensional data models to improve data accessibility, efficiency, and quality.
  • Big Data Engineering:
  • Utilize the Hadoop stack extensively (HDFS, MapReduce, Pig, Hive, HBase, Flume, Sqoop).
  • Develop and maintain solutions using NoSQL stores like Cassandra and HBase.
  • Build and manage data pipelines using stream-processing frameworks such as Spark-Streaming.
  • Data Management & BI:
  • Manage the business intelligence team and vendor partners, prioritizing projects based on business needs.
  • Develop high-quality dashboards using industry best practices.
  • Analyze and confirm the integrity of source data.
  • Lead the deployment and auditing of data models for accuracy.
  • Team & Vendor Management:
  • Manage a team of data engineers, including full-time associates and third-party resources.
  • Foster a cooperative work environment and assist team members in achieving group goals.


Required Skills & Qualifications:

  • Experience: 6-10+ years of proven experience as a Big Data Engineer.
  • Big Data Frameworks: In-depth knowledge of Hadoop (Cloudera distribution preferred), Spark, and similar frameworks.
  • Big Data Tools: Proficiency with Big Data querying tools like Pig, Hive, and Impala.
  • Programming Languages: Strong skills in Java and object-oriented/function scripting languages like Python or Scala.
  • Database Expertise:
  • Advanced SQL skills with expertise in performance tuning.
  • Experience with relational SQL (e.g., Postgres) and NoSQL databases (e.g., Cassandra).
  • Data Modeling: Experience in designing and building dimensional data models.
  • Stream Processing: Hands-on experience with stream-processing systems (e.g., Spark-Streaming, Storm).


Desired Skills (Pluses):

  • Experience with Azure cloud services.
  • Knowledge of the Banking/Financial Services industry.
  • Familiarity with data science and machine learning tools and technologies.
  • Knowledge of other scripting languages like C++, Linux, Ruby, PHP, or R.

Personal Attributes:

  • Excellent problem-solving skills for complex networking, data, and software issues.
  • Ability to effectively plan, organize, and prioritize work.
  • Strong interpersonal and communication skills.
  • A collaborative team player who builds and maintains positive work relationships.

  • Data Engineer

    4 days ago

    Surat, India Cephei Infotech Full time

    Data Engineer (SQL & Python Expertise Required)Experience: 0.5-2 YearsCompany: Cephei InfotechJob Type: Full-TimeAbout UsCephei Infotech is a leading Data & Analytics-focused IT company, delivering scalable data engineering, business intelligence, and AI-driven solutions. We help businesses unlock the power of data through robust pipelines, real-time...

  • Data Engineer

    2 weeks ago

    Surat, Gujarat, India Anand Systems Inc Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Location:Surat (Work from office)Reports to:Chief Product Officer (CPO)Employment Type:Full-timeEmail- About The RoleWe are seeking aSenior Data Engineerto design and build the next generation of our data infrastructure. This role combinesdata pipeline engineeringwithanalytics enablement, helping the company transform raw data into trusted, actionable...

  • Senior Data Engineer

    4 days ago

    Surat, India AIQU Full time

    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Job Details:Role: Senior Data Engineer Work Location: Remote Employment Type: Contract – 12 months & extendableRole Summary:The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power...

  • Data Engineer

    1 week ago

    Surat, India ACL Digital Full time

    Hello Folks,Grab the excellent opportunity with our companyExperience: 5+yearsNotice Period: Immediate to 15daysLocation: Bangalore/Hyderabad/Pune/Chennai/Noida/AhmedabadJob Description:5+Years in Data Engineering with GCPDatabricks-Unity CatalogRest APIUnit TestingPython/PysparkCICD/Terraform(Optional)Interested people can send their resumes to...

  • Senior data integration engineer

    6 days ago

    Surat, India Indsafri Full time

    Job Title - Senior Data Integration EngineerExperience - 6+YearsJob SummaryWe are seeking a highly experienced and strategic Senior Data Integration Engineer to architect, build, and manage the data pipelines that power our customer intelligence ecosystem. In this critical role, you will be the subject matter expert responsible for designing and implementing...

  • Manager - Data Engineering

    2 weeks ago

    Surat, Gujarat, India Core Minds Tech SOlutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Description : In this role, you will : - Manage and develop team of data analysts with low to moderate complexity and risk in data management and technology, and engage stakeholders and internal partners - Identify and recommend opportunities for process improvement and risk control development - Operate data environments, integrate with new...

  • Senior DevOps + Data Engineer

    4 days ago

    Surat, India IT Merchant Full time

    Key ResponsibilitiesDevOps & Infrastructure:- Design, implement, and manage CI/CD pipelines for multiple environments. - Automate provisioning, deployment, and scaling of infrastructure across AWS, GCP, or Azure. - Implement monitoring, alerting, and logging frameworks using tools such as Prometheus, Grafana, ELK Stack, or CloudWatch. - Ensure high...

  • Generative AI Engineer

    2 weeks ago

    Vesu, Surat, Gujarat, India Blue Data Consulting Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Overview:We are seeking a talented Generative AI Engineer with 2–3 years of experience to design, develop, and deploy AI models capable of generating high-quality content, including text, images, code, and other media. The ideal candidate will have hands-on experience with generative AI frameworks, machine learning pipelines, and a strong understanding of...

  • Social media data engineer

    2 weeks ago

    Surat, India Deeter Investments LLP Full time

    NOTE: IF YOU HAVE NO EXPERIENCE AQUIRING BULK SOCIAL MEDIA DATA DO NOT APPLY-Please explain your relevant experience clearly at the TOP of your CV. If you do not you will not be considered About Deeter InvestmentsDeeter Investments is a founder-led proprietary trading firm built around real-time, data-driven decision-making. We prize curiosity,...

  • AI/ML Intern

    5 days ago

    Surat, Gujarat, India Blue Data Consulting Full time ₹ 1,20,000 per year

    This internship provides a unique opportunity to work alongside experienced professionals, contributing to real-world projects that impact our company's success.Job Responsibilities:Collect, clean, and pre-process data for machine learning purposes.Work with diverse datasets to ensure their quality and relevance to the project.Assist in developing and...