Data Engineer Expert

4 weeks ago

Chennai, Tamil Nadu, India Ciklum Full time

About Ciklum

Ciklum is a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts, and product owners, we engineer technology that redefines industries and shapes the way people live.

About the Role

We are looking for an Expert Data Engineer to join our team full-time in India. As a key member of our development team, you will be responsible for building, deploying, and maintaining mission-critical analytics solutions that process data quickly at big data scales.

Responsibilities

  • Design, code, configure, and document components that manage data ingestion, real-time streaming, batch processing, data extraction, transformation, and loading across multiple data storages.
  • Own components of the engineering infrastructure and work to continually improve it, identifying gaps and improving the platform's quality, robustness, maintainability, and speed.
  • Cross-train other team members on technologies being developed, while also continuously learning new technologies from other team members.
  • Interact with engineering teams and ensure that solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliability.
  • Perform development, QA, and dev-ops roles as needed to ensure total end-to-end responsibility of solutions.
  • Work directly with business analysts and data scientists to understand and support their use cases.
  • Contribute to the Unit's activities and community building, participate in conferences, provide excellence in exercise and best practices.
  • Help in sales activities, customer meetings, and digital services.

Requirements

We know that sometimes, you can't tick every box. We would still love to hear from you if you think you're a good fit.

  • 5+ years of experience coding in SQL, Java, Python, Scala, with solid CS fundamentals including data structure and algorithm design.
  • 3+ years contributing to production deployments of large backend data processing and analysis systems as a team lead.
  • 2+ years of hands-on implementation experience working with a combination of the following technologies: Hadoop, Map Reduce, Pig, Hive, Impala, Spark, Kafka, Storm, SQL, and NoSQL data warehouses such as HBase and Cassandra.
  • 3+ years of experience in cloud data platforms (AWS, Azure, GCP).
  • Detailed knowledge and understanding of Data Governance process definition, development, and deployment. This should include data quality, security, and other data management standards & practices.
  • Demonstrable experience in leading development teams including managing the teams backlog and assigning tasks to team members, leading on maintaining development standards & the peer review process.
  • Ability to work on and manage multiple projects simultaneously while adapting to changing priorities in a fast-paced environment.
  • Knowledge of SQL and MPP databases (. Vertica, Netezza, Greenplum, Aster Data).
  • Knowledge of professional software engineering best practices for the full software development life cycle.
  • Knowledge of Data Warehousing, design, implementation, and optimization.
  • Knowledge of Data Quality testing, automation, and results visualization.
  • Knowledge of BI reports and dashboards design and implementation (PowerBI, Tableau).
  • Knowledge of development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
  • Experience participating in an Agile software development team,. SCRUM.
  • Experience designing, documenting, and defending designs for key components in large distributed computing systems.
  • A consistent track record of delivering exceptionally high-quality software on large, complex, cross-functional projects.
  • Demonstrated ability to learn new technologies quickly and independently.
  • Understanding of cloud infrastructure design and implementation.
  • Undergraduate degree in Computer Science or Engineering from a top CS program required. Masters preferred.
  • Experience with supporting data scientists and complex statistical use cases highly desirable.

Desirable

  • Experience in data science and machine learning.
  • Experience in backend development and deployment.
  • Experience in CI/CD configuration.
  • Good knowledge of data analysis in enterprises.
  • Experience with Databricks, Snowflake.
  • Experience with Kubernetes.

What's in it for you

  • Care: your mental and physical health is our priority. We ensure comprehensive company-paid medical insurance, as well as financial and legal consultation.
  • Tailored education path: boost your skills and knowledge with our regular internal events (meetups, conferences, workshops), Udemy license, language courses, and company-paid certifications.
  • Growth environment: share your experience and level up your expertise with a community of skilled professionals, locally and globally.
  • Flexibility: hybrid work mode at Chennai or Pune.
  • Opportunities: we value our specialists and always find the best options for them. Our Resourcing Team helps change a project if needed to help you grow, excel professionally, and fulfill your potential.
  • Global impact: work on large-scale projects that redefine industries with international and fast-growing clients.
  • Welcoming environment: feel empowered with a friendly team, open-door policy, informal atmosphere within the company, and regular team-building events.

  • Data Modeling Expert

    3 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Data Modeling Expert to join our team in Chennai, Tamil Nādu (IN), India (IN). As a Scrum Master, you will be responsible for leading our data and analytics team in the development of innovative solutions using the latest technologies and methodologies.Key ResponsibilitiesTransform the application development by...

  • Data Engineer Expert

    7 days ago

    Chennai, Tamil Nadu, India Ciklum Full time

    Data Engineer Expert OpportunityAbout CiklumCiklum, a custom product engineering company, is seeking a highly skilled Data Engineer Expert to join our team in India.We are a global team of over 4,000 developers, consultants, analysts, and product owners who engineer technology that redefines industries and shapes the way people live.About the RoleAs a Data...

  • Technical Specialist

    3 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionMake an impact with NTT DATANTT DATA is a global leader in business and technology services, serving 75% of the Fortune Global 100. We are committed to helping clients innovate, optimize, and transform for long-term success. Our team of experts provides cutting-edge solutions in data and artificial intelligence, industry solutions, and...

  • Data Engineering Expert

    3 weeks ago

    Chennai, Tamil Nadu, India Ciklum Full time

    About the Role:Ciklum is seeking a highly skilled Data Engineering Expert to join our team in India.We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges.As a Data Engineering Expert, you will be part of a cross-functional development team engineering...

  • Data Engineer Expert

    4 weeks ago

    Chennai, Tamil Nadu, India Ciklum Full time

    About CiklumCiklum is a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges.We are a global team of over 4,000 highly skilled developers, consultants, analysts, and product owners who engineer technology that redefines industries and shapes the way people...

  • AWS Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to lead our data infrastructure team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure....

  • Senior Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Daxx Full time

    Job Title: Senior Data Engineer - Cloud ExpertJob Summary:We are seeking a highly skilled Senior Data Engineer - Cloud Expert to join our team at Grid Dynamics. As a Senior Data Engineer, you will be responsible for designing and implementing scalable data pipelines using Azure Data Bricks, Azure platform, ADF, Azure Datalake, and Azure Blob Storage.Key...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job SummaryWe are seeking a highly skilled and experienced Data Engineer to join our team in Chennai, Tamil Nādu, India. The ideal candidate will have expertise in designing, implementing, and supporting Cloud Data Management and Advanced Analytics platforms.Main ResponsibilitiesDesign and implement Cloud Data Management and Advanced Analytics...

  • Senior OpenShift Expert

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionAt NTT DATA, we are seeking an experienced Senior OpenShift Expert to join our team. As a Senior OpenShift Expert, you will be responsible for managing and maintaining Red Hat OpenShift/Kubernetes clusters, with a focus on installation, upgrade, and migration.Key ResponsibilitiesManage and maintain Red Hat OpenShift/Kubernetes clusters,...

  • Technical Specialist

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    About the RoleThe Technical Specialist will be responsible for providing expert technical support to field engineers, technicians, and product support personnel who are diagnosing, troubleshooting, repairing, and debugging complex electro/mechanical equipment, computer systems, complex software, or networked and/or wireless systems.Your Key...

  • Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Altimetrik Full time

    Job Title: Data Engineer - Cloud ExpertWe are seeking a highly skilled Data Engineer with expertise in Google Cloud Platform (GCP), particularly in BigQuery and Pub/Sub, coupled with advanced proficiency in Python. As a Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data pipelines, ensuring the smooth flow of data...

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Aryng Full time

    Welcome to the Data Engineer role at Aryng, where you will design, develop, and manage scalable data pipelines using cloud-native tools. We are seeking an entrepreneurial and technology-proficient Data Engineer who is an expert in the implementation of a large-scale, highly efficient data platform, batch, and real-time pipelines and tools for our...

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India TapTalent Full time

    Job Title: Data Engineer - Scala Spark ExpertJob Description:We are seeking a highly skilled Data Engineer with expertise in Scala Spark to join our team at TapTalent. The ideal candidate will have a deep understanding of modern data processing technology stacks, including Spark, HBase, Hive, and other Hadoop ecosystem technologies. They will also have...

  • Data Modelling Expert

    1 week ago

    Chennai, Tamil Nadu, India Spectrum Consulting Full time

    Data Modelling ExpertiseAt Spectrum Consulting, we seek an experienced Data Modelling Expert to join our team. The ideal candidate will possess expert understanding of data models, normalization, and denormalization patterns, as well as the ability to reverse engineer data models and relationships between tables. Key responsibilities include profiling data...

  • Data Center Operations Specialist

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionMake an Impact at NTT DATANTT DATA is a global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize, and transform for long-term success.Your RoleThe role of Critical Facilities Operations and Maintenance Engineer is a seasoned subject matter expert...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Archimedis Digital Full time

    Archimedis Digital Seeks Snowflake ExpertWe are looking for a highly skilled Data Engineer to join our team at Archimedis Digital. The ideal candidate will have a deep understanding of Snowflake, data warehousing methodologies, and modeling techniques.Main Responsibilities:Provide expertise in Snowflake data solutions, including data migration methods and...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time

    Job Title: Data Engineer - Cloud Computing ExpertJob Summary: We are seeking an experienced Data Engineer to join our team at Colan Infotech Private Limited. The ideal candidate will have a strong background in cloud computing, data pipelines, and scalable data solutions.Key Responsibilities:Design, develop, and maintain scalable data pipelines using...

  • Data Analytics Expert

    2 weeks ago

    Chennai, Tamil Nadu, India Virtusa Full time

    Key ResponsibilitiesData Engineering and ETL ToolsGen AI OrchestrationLLM Integration and Prompt EngineeringAs a highly skilled Data Analytics Expert, you will be responsible for designing and implementing data pipelines and infrastructure to support AI Solutions. You will work closely with Gen AI leads and other team members to address requirements from the...

  • Data Engineer

    7 days ago

    Chennai, Tamil Nadu, India Altimetrik Full time

    Data Engineer - GCP Expert Job DescriptionAltimetrik is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a pivotal role in designing, implementing, and optimizing data pipelines using Google Cloud Platform (GCP) services.Responsibilities:Architect and develop scalable and efficient data pipelines using GCP services...

  • Data Engineering Leader

    3 weeks ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Director of Data EngineeringJob Summary:Wavicle Data Solutions is seeking an experienced and visionary Director of Data Engineering to lead and manage our growing Data Engineering team. As a Director, you will be responsible for driving the technical strategy, overseeing complex data projects, and delivering high-quality solutions that support our...