Senior Data Engineer

3 days ago

Ahmedabad, India eInfochips (An Arrow Company) Full time

Role: Senior Data Engineer

Years of Experience: 5-10

Location: Ahmedabad

Overview:

We are seeking a highly skilled and experienced Senior Software Engineer to join our Data Engineering team. The ideal candidate will have 5 to 10 years of experience in software engineering, with a strong focus on data engineering practices and an awareness of AI/ML and Generative AI technologies. This role demands proficiency in data processing and analysis, with a keen understanding of both the technical and business aspects of data engineering.


Key Responsibilities:

  • Design, develop, and maintain data pipelines and architectures.
  • Implement and optimize data integration and transformation processes.
  • Collaborate with data scientists and machine learning engineers to integrate AI/ML models into data workflows.
  • Utilize cloud platforms (AWS, GCP, Azure) to deploy and manage data solutions.
  • Ensure high-quality data ingestion and processing through rigorous testing and validation.
  • Participate in code reviews to maintain high code quality and standards.
  • Troubleshoot and debug data engineering solutions, ensuring reliability and performance.
  • Work with version control systems (preferably git) to manage and maintain codebases.


Mandatory Skills (Need Proficiency):

  • Experience: 5 to 10 years in software/data engineering.
  • Data Technologies: Proficiency in SQL, NoSQL databases (e.g., DynamoDB, MongoDB), ETL tools, and data warehousing solutions.
  • Programming Languages: Proficiency in Python is a must.
  • Cloud Platforms: Azure, AWS (e.g., EC2, S3, RDS) or GCP.
  • Visualization Tools: Experience with data visualization tools (e.g., Tableau, Power BI, Looker).
  • Data Governance: Knowledge of data governance and security practices.
  • CI/CD: Experience with DevOps practices, including CI/CD pipelines and containerization (Docker, Kubernetes).
  • Communication Skills: Excellent verbal and written communication skills in English.
  • Agile Methodologies: Experience working in Agile development environments.
  • AI/ML Awareness: Understanding of AI and ML concepts, frameworks (e.g., TensorFlow, PyTorch), and practical applications.0
  • Generative AI Awareness: Familiarity with Generative AI technologies and their potential use cases.


Good to Have Skills:

  • APIs: Understanding of RESTful APIs and their integration into data workflows.
  • Advanced Analytics: Knowledge of advanced analytics and statistical techniques.
  • Microservices: Familiarity with microservices architecture and its implementation.
  • Data Lakes: Understanding of data lakes and their role in modern data architecture.
  • Scripting: Proficiency in shell scripting and automation.
  • AI/ML Deployment: Experience working with and deploying AI/ML models in production environments.
  • Big Data Tools: Experience with Hadoop, Spark, Kafka, and other big data technologies.


Qualifications:

- Education: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

- Certifications: Relevant certifications in data engineering, cloud platforms, or AI/ML are a plus.

  • Senior Data Engineer for Innovative Data Analytics

    2 weeks ago

    Ahmedabad, Gujarat, India ANBLICKS CLOUD DATA ENGG PRIVATE LIMITED Full time

    OverviewWe are seeking a highly skilled Senior Data Engineer to join our team at Anblicks Cloud Data Engg Private Limited in Hyderabad or Ahmedabad. The ideal candidate will have strong knowledge of Python and SQL, with a clear understanding of data warehouse fundamentals, data modeling, and ELT/ETL processes. Job DescriptionAs a Senior Data Engineer, you...

  • Crest Data | Senior Software Engineer/Technical Lead

    4 weeks ago

    ahmedabad, India Crest Data Full time

    Company Overview: Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Crest Data | Senior Software Engineer/Technical Lead

    4 weeks ago

    ahmedabad, India Crest Data Full time

    Company Overview: Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Anblicks - Senior Data Engineer - ETL

    2 months ago

    Ahmedabad, India ANBLICKS CLOUD DATA ENGG PRIVATE LIMITED Full time

    Position : Senior Data Engineer Product Engineering. Location : Hyderabad or Ahmedabad. No of Requirement : 5. Role Objective : We are seeking a highly skilled Data Engineer to join our innovations group. You will lead projects to build accelerators, Points of Views (POVs), Proof of Concepts (POCs), and conduct research on emerging technologies. Key...

  • Anblicks - Senior Data Engineer - ETL

    2 weeks ago

    Ahmedabad, India ANBLICKS CLOUD DATA ENGG PRIVATE LIMITED Full time

    Position : Senior Data Engineer Product Engineering. Location : Hyderabad or Ahmedabad. No of Requirement : 5. Role Objective : We are seeking a highly skilled Data Engineer to join our innovations group. You will lead projects to build accelerators, Points of Views (POVs), Proof of Concepts (POCs), and conduct research on emerging technologies. Key...

  • Senior Software Engineer

    6 days ago

    Ahmedabad, Gujarat, India Crest Data Full time

    Job Title: Senior Software Engineer - Technical LeadAbout Crest DataCrest Data is a leading provider of data analytics, security, DevOps, cloud solutions, software integrations, and technology services. We cater to top Fortune 500 corporations and innovative startups in Silicon Valley.Job OverviewWe are seeking an experienced Senior Software Engineer to lead...

  • Senior software engineer/technical lead

    3 weeks ago

    Ahmedabad, India Crest Data Full time

    Company Overview: Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, Net App, Amazon AWS,...

  • Senior Software Engineer/Technical Lead

    4 weeks ago

    Ahmedabad, India Crest Data Full time

    Company Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Senior software engineer/technical lead

    2 weeks ago

    Ahmedabad, India Crest Data Full time

    Company Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, Net App, Amazon AWS, EMC,...

  • Senior Software Engineer/Technical Lead

    4 weeks ago

    Ahmedabad, India Crest Data Full time

    Company Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Senior software engineer/technical lead

    4 weeks ago

    Ahmedabad, India Crest Data Full time

    Company Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, Net App, Amazon AWS, EMC,...

  • Senior Software Engineer/Technical Lead

    4 weeks ago

    ahmedabad, India Crest Data Full time

    Company Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...

  • Crest Data | Sr. Golang Engineer | ahmedabad

    3 weeks ago

    ahmedabad, India Crest Data Full time

    Job Description - Senior Software Engineer (Golang) We are looking for an experienced Golang Engineer to join our team as a Senior Software Engineer in Ahmedabad. Below are the key details of the role:Roles and Responsibilities:Review software requirements and develop test strategies and plans.Design and implement complex Golang modules and scalable,...

  • Lead Java Developer Position for Data Center Solutions

    2 weeks ago

    Ahmedabad, Gujarat, India Crest Data Full time

    Senior Software Engineer/Technical Lead OpportunityCrest Data Systems is seeking a highly skilled Senior Software Engineer/Technical Lead to join our team in Ahmedabad, Gujarat. This role offers a unique chance to work on cutting-edge data center solutions and contribute to the company's growth.About Us:Crest Data is a leading provider of engineering...

  • Senior Data Engineer

    3 weeks ago

    Ahmedabad, Gujarat, India Staffington Consulting Pvt Ltd Full time

    Job Title: Senior Data EngineerJob Summary:We're seeking a highly skilled Senior Data Engineer to join our team at Staffington Consulting Pvt Ltd. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data systems.Key Responsibilities:Design and implement data pipelines using Snowflake...

  • Senior Software Engineer/Technical Lead

    4 weeks ago

    ahmedabad, India Crest Data Full time

    Company Overview: Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS,...

  • Senior Data Engineer

    3 weeks ago

    Ahmedabad, India Infraveo Full time

    This is a remote position. As a Senior Data Engineer you will be responsible for designing, implementing, and maintaining robust data infrastructure solutions and a complex ETL which drives our core business operations. You will work closely with our team to ensure the efficient and effective processing of large datasets. Your expertise in SQL and ETL...

  • Senior Data Engineer

    2 months ago

    Ahmedabad, India ANBLICKS CLOUD DATA ENGG PRIVATE LIMITED Full time

    Data Engineering Team LeadWe are seeking a highly skilled Data Engineer to lead our innovations group.Key Responsibilities:Design, develop, and maintain innovative end-to-end data analytics and technology solutions.Work with data warehouses and data lakes, ensuring data is accurate, available, and easily accessible.Implement ELT/ETL processes using...

  • Senior Data Engineering Specialist

    1 month ago

    Ahmedabad, Gujarat, India Resolute Corp Full time

    At Resolute Corp, we're seeking a highly skilled Data Engineer to join our growing data team. This is an exciting opportunity for someone with 1-3 years of experience who wants to develop their skills in data engineering and cloud technologies.Key ResponsibilitiesAssist in building and maintaining ETL (Extract, Transform, Load) pipelines to ingest and...

  • Senior Data Engineer

    3 weeks ago

    Ahmedabad, India Infraveo Full time

    Job Description This is a remote position. As a Senior Data Engineer you will be responsible for designing, implementing, and maintaining robust data infrastructure solutions and a complex ETL which drives our core business operations. You will work closely with our team to ensure the efficient and effective processing of large datasets. Your expertise in...