Expert Data Engineer

4 months ago

Chennai, India Ciklum Full time

Description

Ciklum is looking for an Expert Data Engineer to join our team full-time in India.

We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.

About the role:

As an Expert Data Engineer, become a part of a cross-functional development team engineering experiences of tomorrow. 

Responsibilities

Responsible for the building, deployment, and maintenance of mission critical analytics solutions that process data quickly at big data scales Contributes design, code, configurations, and documentation for components that manage data ingestion, real time streaming, batch processing, data extraction, transformation, and loading across multiple data storages Owns components of the engineering infrastructure and works to continually improve it, identifying gaps and improving the platform’s quality, robustness, maintainability, and speed Cross-trains other team members on technologies being developed, while also continuously learning new technologies from other team members Interacts with engineering teams and ensures that solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliability Performs development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions Works directly with business analysts and data scientists to understand and support their use-cases Contribute in the Unit’s activities and community building, participate in conferences, provide excellence in exercise and best practices Help in sales activities, customer meetings and digital services

Requirements

We know that sometimes, you can’t tick every box. We would still love to hear from you if you think you’re a good fit

5+ years of experience coding in SQL, Java, Python, Scala, with solid CS fundamentals including data structure and algorithm design 3+ years contributing to production deployments of large backend data processing and analysis systems as a team lead 2+ years of hands-on implementation experience working with a combination of the following technologies: Hadoop, Map Reduce, Pig, Hive, Impala, Spark, Kafka, Storm, SQL and NoSQL data warehouses such as Hbase and Cassandra 3+ years of experience in cloud data platforms (AWS, Azure, GCP) Detailed knowledge and understanding of Data Governance process definition, development and deployment. This should include data quality, security and other data management standards & practices Demonstrable experience in leading development teams including managing the teams backlog and assigning tasks to team members, leading on maintaining development standards & the peer review process Ability to work on and manage multiple projects simultaneously while adapting to changing priorities in a fast-paced environment Knowledge of SQL and MPP databases (. Vertica, Netezza, Greenplum, Aster Data) Knowledge of professional software engineering best practices for the full software Knowledge of Data Warehousing, design, implementation and optimization Knowledge of Data Quality testing, automation and results visualization Knowledge of BI reports and dashboards design and implementation (PowerBI, Tableau) Knowledge of development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations Experience participating in an Agile software development team, . SCRUM Experience designing, documenting, and defending designs for key components in large distributed computing systems A consistent track record of delivering exceptionally high-quality software on large, complex, cross-functional projects Demonstrated ability to learn new technologies quickly and independently Understanding of cloud infrastructure design and implementation Undergraduate degree in Computer Science or Engineering from a top CS program required. Masters preferred Experience with supporting data scientists and complex statistical usecases highly desirable

Desirable

Experience in data science and machine learning Experience in backend development and deployment Experience in CI/CD configuration Good knowledge of data analysis in enterprises Experience with Databricks, Snowflake Experience with Kubernetes

What's in it for you

Care: your mental and physical health is our priority. We ensure comprehensive company-paid medical insurance, as well as financial and legal consultation Tailored education path: boost your skills and knowledge with our regular internal events (meetups, conferences, workshops), Udemy licence, language courses and company-paid certifications Growth environment: share your experience and level up your expertise with a community of skilled professionals, locally and globally Flexibility: hybrid work mode at Chennai or Pune Opportunities: we value our specialists and always find the best options for them. Our Resourcing Team helps change a project if needed to help you grow, excel professionally and fulfil your potential Global impact: work on large-scale projects that redefine industries with international and fast-growing clients Welcoming environment: feel empowered with a friendly team, open-door policy, informal atmosphere within the company and regular team-building events

  • Senior Data Engineer

    3 weeks ago

    Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time

    **Job Title:** Senior Data Engineer - Databricks Expert**About Eucloid Data Solutions Pvt Ltd**Eucloid Data Solutions Pvt Ltd is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning, and Data engineering. Our team supports various business applications by developing data...

  • Data Engineer

    4 weeks ago

    Chennai, India NTT DATA Full time

    Job Description Req ID: 298625 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe...

  • Data Engineer Expert

    3 weeks ago

    Chennai, Tamil Nadu, India Ciklum Full time

    Data Engineer Expert OpportunityAbout CiklumCiklum, a custom product engineering company, is seeking a highly skilled Data Engineer Expert to join our team in India.We are a global team of over 4,000 developers, consultants, analysts, and product owners who engineer technology that redefines industries and shapes the way people live.About the RoleAs a Data...

  • Technical Specialist

    1 month ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionMake an impact with NTT DATANTT DATA is a global leader in business and technology services, serving 75% of the Fortune Global 100. We are committed to helping clients innovate, optimize, and transform for long-term success. Our team of experts provides cutting-edge solutions in data and artificial intelligence, industry solutions, and...

  • Data Engineer

    4 weeks ago

    Chennai, India NTT DATA Services Full time

    Req ID: 298625 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN).Data EngineerJob SummaryWe are looking for...

  • AWS Data Engineer

    1 month ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to lead our data infrastructure team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure....

  • Cybersecurity Engineer for NTT DATA

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Company OverviewNTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success.We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the...

  • Cloud Security Systems Integration Expert

    5 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job OverviewWe are seeking a highly skilled Cloud Security Systems Integration Expert to provide engineering support for our large Azure Active Directory (AAD) environment.About the RoleThe successful candidate will be responsible for testing and engineering for Azure AD, including objects, policies, management, security, and support infrastructures like AD...

  • Senior Data Engineer

    1 month ago

    Chennai, Tamil Nadu, India Daxx Full time

    Job Title: Senior Data Engineer - Cloud ExpertJob Summary:We are seeking a highly skilled Senior Data Engineer - Cloud Expert to join our team at Grid Dynamics. As a Senior Data Engineer, you will be responsible for designing and implementing scalable data pipelines using Azure Data Bricks, Azure platform, ADF, Azure Datalake, and Azure Blob Storage.Key...

  • Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job SummaryWe are seeking a highly skilled and experienced Data Engineer to join our team in Chennai, Tamil Nādu, India. The ideal candidate will have expertise in designing, implementing, and supporting Cloud Data Management and Advanced Analytics platforms.Main ResponsibilitiesDesign and implement Cloud Data Management and Advanced Analytics...

  • Engineer (L1) - Titus Data Classification

    4 weeks ago

    Chennai, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer

    1 month ago

    Chennai, India InfoCentroid Software Solutions Pvt. Ltd Full time

    Job Title: Data Engineer - Cloud ExpertCompany: InfoCentroid Software Solutions Pvt. LtdLocation: RemoteExperience: 4 to 9 yearsWork Mode: HybridJob Description:We are seeking a highly skilled Data Engineer with expertise in Google Cloud Platform (GCP) services to design, build, and maintain scalable data pipelines. The ideal candidate will have a strong...

  • Senior OpenShift Expert

    4 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionAt NTT DATA, we are seeking an experienced Senior OpenShift Expert to join our team. As a Senior OpenShift Expert, you will be responsible for managing and maintaining Red Hat OpenShift/Kubernetes clusters, with a focus on installation, upgrade, and migration.Key ResponsibilitiesManage and maintain Red Hat OpenShift/Kubernetes clusters,...

  • Data Engineering Expert

    2 weeks ago

    Chennai, Tamil Nadu, India ResMed Full time

    About the RoleThe Digital Health Technology team at ResMed powers digital experiences and engagement to enhance the lives of millions of people every day through connected care. We build, deliver, and manage a portfolio of data management platforms and mobile offerings in support of our core businesses. As a Data Engineering Expert, you will be immersed in a...

  • Senior Data Engineering Expert

    4 days ago

    Chennai, Tamil Nadu, India Snaphunt Full time

    Job OverviewSnaphunt is seeking an experienced Senior Data Engineering Expert to join our team. This role involves designing and implementing scalable data processing pipelines using Kafka, PySpark, Python/Scala, and Spark.Responsibilities:Develop and maintain robust data processing solutions utilizing the Kafka and Hadoop ecosystem.Collaborate with data...

  • Technical Specialist

    3 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    About the RoleThe Technical Specialist will be responsible for providing expert technical support to field engineers, technicians, and product support personnel who are diagnosing, troubleshooting, repairing, and debugging complex electro/mechanical equipment, computer systems, complex software, or networked and/or wireless systems.Your Key...

  • Data Engineering Expert

    4 weeks ago

    Chennai/Hyderabad/Bangalore/Coimbatore/Mumbai/Delhi/Pune, India GAIUS HYPERLOCAL PRIVATE LIMITED Full time

    Job Title: Data Engineering ExpertAbout Us: At GAIUS HYPERLOCAL PRIVATE LIMITED, we're committed to harnessing the power of big data to drive innovation and business value.Job Description: We're seeking a highly skilled Data Engineering Expert to design, develop, and maintain scalable big data solutions using Apache Spark and other big data technologies.Key...

  • Data Center Operations Specialist

    3 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job DescriptionMake an Impact at NTT DATANTT DATA is a global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize, and transform for long-term success.Your RoleThe role of Critical Facilities Operations and Maintenance Engineer is a seasoned subject matter expert...

  • Data Modelling Expert

    3 weeks ago

    Chennai, Tamil Nadu, India Spectrum Consulting Full time

    Data Modelling ExpertiseAt Spectrum Consulting, we seek an experienced Data Modelling Expert to join our team. The ideal candidate will possess expert understanding of data models, normalization, and denormalization patterns, as well as the ability to reverse engineer data models and relationships between tables. Key responsibilities include profiling data...

  • Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Archimedis Digital Full time

    Archimedis Digital Seeks Snowflake ExpertWe are looking for a highly skilled Data Engineer to join our team at Archimedis Digital. The ideal candidate will have a deep understanding of Snowflake, data warehousing methodologies, and modeling techniques.Main Responsibilities:Provide expertise in Snowflake data solutions, including data migration methods and...