Data engineer

1 day ago

Kollam, India Quantiphi Full time

Role: Associate Architect - Data Experience Level: 6.5 to 12 Years Work location: Mumbai, Bangalore, Trivandrum Role & Responsibilities: 6+ years of experience in building and managing Data Lakes, Data Warehouse, Data Integration, Data Migration and Business Intelligence/Artificial Intelligence solutions on GCP Cloud. Ability to understand business requirements, translate them into functional and non-functional areas, and define non-functional boundaries in terms of Availability, Scalability, Performance, Security, Resilience etc. Experience in architecting, designing, and implementing end-to-end data pipelines and data integration solutions for varied structured and unstructured data sources and targets. Experience of having worked in distributed computing and enterprise environments like Hadoop. Well-versed with various Data Integration, and ETL technologies on Cloud like Spark, Pyspark/Scala. Dataflow, Data Proc, EMR, etc. on various Cloud. Experience of having worked with traditional ETL tools lik Informatica/Data Stage/OWB/Talend, etc. Deep knowledge of one or more Cloud and On-Premise Databases like Cloud SQL, Cloud Spanner, Big Table, RDS, Aurora, Dynamo DB, Oracle, Teradata, My SQL, DB2, SQL Server, etc. Exposure to any of the No-SQL databases like Mongo d B, Couch DB, Cassandra, Graph d B, etc. Experience in architecting and designing scalable data warehouse solutions on cloud on Big Query or Redshift. Experience in having worked on one or more data integration, storage, and data pipeline toolsets like S3, Cloud Storage, Athena, Glue, Sqoop, Flume, Hive, Kafka, Pub-Sub, Kinesis, Dataflow, Data Proc, Airflow, Composer, Spark SQL, Presto, EMRFS, etc. Preferred experience of having worked on Machine Learning Frameworks like Tensor Flow, Pytorch, etc. Good understanding of Cloud solutions for Iaas, Paa S, Saa S, Containers and Microservices Architecture and Design. Ability to compare products and tools across technology stacks on Google, AWS, and Azure Cloud. Good understanding of BI Reposting and Dashboarding and one or more toolsets associated with it like Looker, Tableau, Power BI, SAP BO, Cognos, Superset, etc. Understanding of Security features and Policies in one or more Cloud environments like GCP/AWS/Azure. Experience working in business transformation projects for the movement of On-Premise data solutions to Clouds like GCP/AWS/Azure. Role: Lead multiple data engagements on GCP Cloud for data lakes, data engineering, data migration, data warehouse, and business intelligence. Interface with multiple stakeholders within IT and business to understand the data requirements. Take complete responsibility for the successful delivery of all allocated projects on the parameters of Schedule, Quality, and Customer Satisfaction. Responsible for design and development of distributed, high volume multi-thread batch, real-time, and event processing systems. Implement processes and systems to validate data, and monitor data quality, ensure production data is always accurate and available for key stakeholders and business processes that depend on it. Work with the Pre-Sales team on RFPs, and RFIs and help them by creating solutions for data. Mentor Young Talent within the Team and define and track their growth parameters. Contribute to building Assets and Accelerators. Other Skills: Strong Communication and Articulation Skills. Good Leadership Skills. Should be a good team player. Good Analytical and Problem-solving skills.

  • Data Engineer

    24 hours ago

    Kollam, India Aceolution Full time

    Job Title: Data Engineer – Python Expert(Freelance Role)Location: Remote / HybridEmployment Type: Contract/ FreelanceRole Summary We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) development. As a senior Individual Contributor (IC), you will be the team's expert on...

  • Data Engineer

    4 weeks ago

    Kollam, India Magma Consultancy Full time

    Location: RemoteType: Part-time (20–25 hours per week)About the RoleWe are seeking a skilled Data Engineer to support our growing data operations on a part-time basis. The ideal candidate has hands-on experience in building, optimizing, and maintaining data pipelines and architectures. You’ll work closely with analysts, developers, and business teams...

  • Data Engineer

    4 weeks ago

    Kollam, India Digivance Solutions Full time

    Position: Data EngineerExperience: 5–10 YearsLocation: Chennai, Bengaluru, Pune, Hyderabad, Mumbai, Delhi NCR(candidates will be required to work at any of these locations in hybrid mode)Key ResponsibilitiesCollaborate with business and technology stakeholders to understand current and future data requirements.Design, build, and maintain reliable,...

  • Data Engineer

    4 weeks ago

    Kollam, India Digivance Solutions Full time

    Position: Data EngineerExperience: 5–10 YearsLocation: Chennai, Bengaluru, Pune, Hyderabad, Mumbai, Delhi NCR(candidates will be required to work at any of these locations in hybrid mode)Key ResponsibilitiesCollaborate with business and technology stakeholders to understand current and future data requirements.Design, build, and maintain reliable,...

  • Data Engineer

    1 week ago

    Kollam, India Digitalzone Full time

    About the RoleAs a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.ResponsibilitiesDevelop and maintain scalable ETL/ELT pipelines using Python, Airflow, and dbt Build and optimize real-time streaming pipelines using Kafka, RabbitMQ, Spark and event-driven microservices...

  • Senior Data Engineer

    17 hours ago

    Kollam, India Tata Consultancy Services Full time

    Role**: Senior Data EngineerRequired Technical Skill Set: Senior Data EngineerDesired Experience Range: 7 - 12 yrsNotice Period: Immediate to 90Days onlyLocation of Requirement: BangaloreWe are currently planning to do a Virtual InterviewJob Description:Primary Skills (Java, Python, etc.)Python, Scala/Java, Spark, SQL, Snowflake, BDD, Databricks, AWS Key...

  • Data Engineer

    4 days ago

    Kollam, India Add Min Web World Full time

    Job Title: Data Engineer (Qlik Experience)Location: Mohali (On-site)Experience: Minimum 2 YearWorking Days: 5 Days a WeekJob Description:We are looking for a dedicated Data Engineer who has hands-on experience working with Qlik and other data tools. The ideal candidate should have a strong understanding of data processing, integration, and reporting, along...

  • Data Engineer

    3 weeks ago

    Kollam, India Taiyō.AI Full time

    About UsTaiyo.AI is the world's first infrastructure intelligence platform. We are building the largest universaland industry standard database of opportunities (tenders, projects, news) and threats (economy,climate, geopolitics, finance, logistics, etc.) for real assets. Taiyo.AI has been instrumental in shapinghow infrastructure companies (infra investors,...

  • Python API + Data Engineer

    2 weeks ago

    Kollam, India Digitrix Software LLP Full time

    Experience : 5 to 8 yearsJob description:Python API + Data EngineerWe are looking for aself-motivated Python Data Engineerwith strong skills inbackend/API development and large-scale data processing , who can work independently and thrive in a fast-paced, agile environment.Key ResponsibilitiesDesign, develop, and optimizedata pipelinesusingPySpark, AWS Glue,...

  • Data integration reliability and devops engineer

    4 weeks ago

    Kollam, India RapidBrains Full time

    Job Title: Data Integration Reliability & Dev Ops Engineer Experience: 7–10 Years Location: Remote Contract Duration: Long Term Work Time: Normal IST (with 2–3 hours overlap as per client need)We are seeking a highly skilled Data Integration Reliability & Dev Ops Engineer to join our team. This role focuses on maintaining the operational reliability and...