Senior Data Engineer

2 days ago

Kolkata, India eInfochips (An Arrow Company) Full time

Role: Senior Data Engineer

Years of Experience: 5-10

Location: Ahmedabad

Overview:

We are seeking a highly skilled and experienced Senior Software Engineer to join our Data Engineering team. The ideal candidate will have 5 to 10 years of experience in software engineering, with a strong focus on data engineering practices and an awareness of AI/ML and Generative AI technologies. This role demands proficiency in data processing and analysis, with a keen understanding of both the technical and business aspects of data engineering.


Key Responsibilities:

  • Design, develop, and maintain data pipelines and architectures.
  • Implement and optimize data integration and transformation processes.
  • Collaborate with data scientists and machine learning engineers to integrate AI/ML models into data workflows.
  • Utilize cloud platforms (AWS, GCP, Azure) to deploy and manage data solutions.
  • Ensure high-quality data ingestion and processing through rigorous testing and validation.
  • Participate in code reviews to maintain high code quality and standards.
  • Troubleshoot and debug data engineering solutions, ensuring reliability and performance.
  • Work with version control systems (preferably git) to manage and maintain codebases.


Mandatory Skills (Need Proficiency):

  • Experience: 5 to 10 years in software/data engineering.
  • Data Technologies: Proficiency in SQL, NoSQL databases (e.g., DynamoDB, MongoDB), ETL tools, and data warehousing solutions.
  • Programming Languages: Proficiency in Python is a must.
  • Cloud Platforms: Azure, AWS (e.g., EC2, S3, RDS) or GCP.
  • Visualization Tools: Experience with data visualization tools (e.g., Tableau, Power BI, Looker).
  • Data Governance: Knowledge of data governance and security practices.
  • CI/CD: Experience with DevOps practices, including CI/CD pipelines and containerization (Docker, Kubernetes).
  • Communication Skills: Excellent verbal and written communication skills in English.
  • Agile Methodologies: Experience working in Agile development environments.
  • AI/ML Awareness: Understanding of AI and ML concepts, frameworks (e.g., TensorFlow, PyTorch), and practical applications.0
  • Generative AI Awareness: Familiarity with Generative AI technologies and their potential use cases.


Good to Have Skills:

  • APIs: Understanding of RESTful APIs and their integration into data workflows.
  • Advanced Analytics: Knowledge of advanced analytics and statistical techniques.
  • Microservices: Familiarity with microservices architecture and its implementation.
  • Data Lakes: Understanding of data lakes and their role in modern data architecture.
  • Scripting: Proficiency in shell scripting and automation.
  • AI/ML Deployment: Experience working with and deploying AI/ML models in production environments.
  • Big Data Tools: Experience with Hadoop, Spark, Kafka, and other big data technologies.


Qualifications:

- Education: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

- Certifications: Relevant certifications in data engineering, cloud platforms, or AI/ML are a plus.

  • Senior Data Integration Engineer

    2 weeks ago

    Kolkata, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Senior Data Engineer

    3 weeks ago

    kolkata, India FinArb Consulting Full time

    Job Title: Senior Data Engineer Responsibilities: We are seeking a self-driven Senior Data Engineer to join our dynamic team of data and software engineers. Your primary responsibilities will include: Designing, building, and maintaining scalable data pipelines and workflows. Developing and optimizing data ingestion, transformation, and integration...

  • Senior Data Engineer

    4 weeks ago

    kolkata, India FinArb Consulting Full time

    Job Title: Senior Data EngineerResponsibilities:We are seeking a self-driven Senior Data Engineer to join our dynamic team of data and software engineers. Your primary responsibilities will include:Designing, building, and maintaining scalable data pipelines and workflows.Developing and optimizing data ingestion, transformation, and integration...

  • Senior Data Engineer

    4 weeks ago

    Kolkata, India FinArb Consulting Full time

    Job Title: Senior Data EngineerResponsibilities:We are seeking a self-driven Senior Data Engineer to join our dynamic team of data and software engineers. Your primary responsibilities will include:Designing, building, and maintaining scalable data pipelines and workflows.Developing and optimizing data ingestion, transformation, and integration...

  • Senior Python Data Engineer

    4 days ago

    Kolkata, West Bengal, India Wipro Full time

    At Wipro, we are seeking an experienced Senior Python Data Engineer to join our team. This is a challenging role that requires strong technical skills and the ability to work collaboratively with others.The estimated salary for this position is $120,000 - $180,000 per year, depending on location and experience.About UsWipro is a global information technology...

  • Senior Data Engineering Lead

    2 weeks ago

    Kolkata, West Bengal, India Sibia analytics Full time

    Sibia analytics is a leading provider of innovative data solutions. We are currently seeking a Senior Data Engineering Lead to join our team.Estimated Salary: $180,000 - $220,000 per annum.About the RoleWe are looking for a highly experienced and skilled Senior Data Engineering Lead to lead our data engineering practice. The successful candidate will have...

  • Senior Team Lead

    1 month ago

    Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Senior Data Engineer

    4 weeks ago

    kolkata, India Tredence Inc. Full time

    About Tredence:Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Senior Data Engineer

    4 weeks ago

    kolkata, India Tredence Inc. Full time

    About Tredence:Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Senior Cloud Engineer

    12 hours ago

    Kolkata, West Bengal, India HTC Global Services Full time

    Job SummaryWe are seeking a highly skilled Senior Cloud Engineer to join our team at HTC Global Services. As a Senior Cloud Engineer, you will play a key role in designing and implementing data pipelines on Google Cloud Platform (GCP).About the RoleIn this position, you will work closely with our data engineering team to deliver high-quality software...

  • Senior Data Engineer

    4 weeks ago

    Kolkata, India Tredence Inc. Full time

    About Tredence:Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Senior data engineer

    1 month ago

    Kolkata, India Tredence Inc. Full time

    About Tredence:Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Senior Data Engineer

    1 month ago

    Kolkata, India Tredence Inc. Full time

    About Tredence:Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Senior Data Engineer

    1 month ago

    Kolkata, India Tredence Inc. Full time

    About Tredence:Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Senior Data Engineer

    1 month ago

    Kolkata, India Tredence Inc. Full time

    About Tredence: Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Senior Data Engineer

    4 weeks ago

    Greater Kolkata Area, India FinArb Consulting Full time

    Job Title: Senior Data EngineerResponsibilities:We are seeking a self-driven Senior Data Engineer to join our dynamic team of data and software engineers. Your primary responsibilities will include:Designing, building, and maintaining scalable data pipelines and workflows.Developing and optimizing data ingestion, transformation, and integration...

  • FinArb Consulting | Senior Data Engineer | kolkata

    1 week ago

    Kolkata, India FinArb Consulting Full time

    Job Title:Senior Data EngineerResponsibilities:We are seeking a self-driven Senior Data Engineerto join our dynamic team of data and software engineers. Your primary responsibilities will include:Designing, building, and maintaining scalable data pipelines and workflows.Developing and optimizing data ingestion, transformation, and integration...

  • FinArb Consulting | Senior Data Engineer | kolkata

    1 week ago

    Kolkata, India FinArb Consulting Full time

    Job Title: Senior Data EngineerResponsibilities:We are seeking a self-driven Senior Data Engineer to join our dynamic team of data and software engineers. Your primary responsibilities will include:Designing, building, and maintaining scalable data pipelines and workflows.Developing and optimizing data ingestion, transformation, and integration...

  • Data Engineer

    7 days ago

    Kolkata, West Bengal, India FinArb Consulting Full time

    Job TitleSenior Data EngineerAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at FinArb Consulting. This is an exciting opportunity to work on large-scale data engineering projects, leveraging modern technologies to drive impactful insights.Key ResponsibilitiesDesign and build scalable data pipelines and workflows using...

  • FinArb Consulting | Senior Data Engineer | kolkata

    3 weeks ago

    kolkata, India FinArb Consulting Full time

    Job Title: Senior Data Engineer Responsibilities: We are seeking a self-driven Senior Data Engineer to join our dynamic team of data and software engineers. Your primary responsibilities will include: Designing, building, and maintaining scalable data pipelines and workflows. Developing and optimizing data ingestion, transformation, and integration...