Data Engineer

3 weeks ago

Kollam, India Taiyō.AI Full time

About UsTaiyo.AI is the world's first infrastructure intelligence platform. We are building the largest universaland industry standard database of opportunities (tenders, projects, news) and threats (economy,climate, geopolitics, finance, logistics, etc.) for real assets. Taiyo.AI has been instrumental in shapinghow infrastructure companies (infra investors, engineering, procurement, construction, and infrainsurers) benchmark new project development opportunities, get a panoramic and dynamic view ofexternal risks, predict prices, identify drivers, and mitigate supply-side disruptions. We are seeking acandidate that is willing to learn and contribute to emerging technology and policy.Responsibilities:1. Work on data sourcing2. Use web scrapers (Beautifulsoup, selenium, etc.)3. Manage the data normalization and standards validation4. Parametrize and automate the scrapers5. Develop and execute the processes for monitoring data sanity and checking for data availabilityand reliability6. Understand the business drivers and build insights through data7. Work with the stakeholders at all levels to establish current and ongoing data support andreporting needs8. Ensure continuous data accuracy and recognize data discrepancies in systems that requireimmediate attention/escalation9. Work and become an expert in the company's data warehouse and other data storage tools,understanding the definition, context, and proper use of all attributes and metrics10. Create dashboards based on business requirements11. Work on the distributed systems, scale, cloud, caching, CI/CD (continuous integration anddeployment), distributed logging, data pipeline, REST API)Requirements:- Bachelor's degree in Computer Science, Engineering, or related field or must be completingtheir graduation in 2025- Proven experience in data engineering and ETL development.- Proficiency in programming languages such as Python, Java, or Scala.- Hands-on experience with big data technologies (e.g., Hadoop, Spark, Kafka) and cloudplatforms (e.g., AWS, Azure, GCP).- Strong SQL skills and experience with database systems.- Excellent problem-solving and analytical abilities.- Effective communication and collaboration skills.Benefits:- Competitive salary- Comprehensive benefits- Flexible schedule- Work from home option- Opportunities for rapid growth and career advancement- Exciting work culture with a focus on innovation and collaboration- Sense of ownership and impact in a dynamic organizationApply here: https://docs.google.com/forms/d/e/1FAIpQLSeHeVmkZ2h2KtQq2uisokZFrGNEVJT0UhWa8fBLZT27TyA08g/viewform?usp=sharing&ouid=109654441412058597015

  • Data Engineer

    1 day ago

    Kollam, India Aceolution Full time

    Job Title: Data Engineer – Python Expert(Freelance Role)Location: Remote / HybridEmployment Type: Contract/ FreelanceRole Summary We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) development. As a senior Individual Contributor (IC), you will be the team's expert on...

  • Data Engineer

    4 weeks ago

    Kollam, India Magma Consultancy Full time

    Location: RemoteType: Part-time (20–25 hours per week)About the RoleWe are seeking a skilled Data Engineer to support our growing data operations on a part-time basis. The ideal candidate has hands-on experience in building, optimizing, and maintaining data pipelines and architectures. You’ll work closely with analysts, developers, and business teams...

  • Data Engineer

    4 weeks ago

    Kollam, India Digivance Solutions Full time

    Position: Data EngineerExperience: 5–10 YearsLocation: Chennai, Bengaluru, Pune, Hyderabad, Mumbai, Delhi NCR(candidates will be required to work at any of these locations in hybrid mode)Key ResponsibilitiesCollaborate with business and technology stakeholders to understand current and future data requirements.Design, build, and maintain reliable,...

  • Data Engineer

    4 weeks ago

    Kollam, India Digivance Solutions Full time

    Position: Data EngineerExperience: 5–10 YearsLocation: Chennai, Bengaluru, Pune, Hyderabad, Mumbai, Delhi NCR(candidates will be required to work at any of these locations in hybrid mode)Key ResponsibilitiesCollaborate with business and technology stakeholders to understand current and future data requirements.Design, build, and maintain reliable,...

  • Data Engineer

    1 week ago

    Kollam, India Digitalzone Full time

    About the RoleAs a Data Engineer, you will design, build, and optimize data pipelines and real-time systems that power AI-driven decisioning and analytics.ResponsibilitiesDevelop and maintain scalable ETL/ELT pipelines using Python, Airflow, and dbt Build and optimize real-time streaming pipelines using Kafka, RabbitMQ, Spark and event-driven microservices...

  • Senior Data Engineer

    18 hours ago

    Kollam, India Tata Consultancy Services Full time

    Role**: Senior Data EngineerRequired Technical Skill Set: Senior Data EngineerDesired Experience Range: 7 - 12 yrsNotice Period: Immediate to 90Days onlyLocation of Requirement: BangaloreWe are currently planning to do a Virtual InterviewJob Description:Primary Skills (Java, Python, etc.)Python, Scala/Java, Spark, SQL, Snowflake, BDD, Databricks, AWS Key...

  • Data engineer

    1 day ago

    Kollam, India Quantiphi Full time

    Role: Associate Architect - Data Experience Level: 6.5 to 12 Years Work location: Mumbai, Bangalore, Trivandrum Role & Responsibilities: 6+ years of experience in building and managing Data Lakes, Data Warehouse, Data Integration, Data Migration and Business Intelligence/Artificial Intelligence solutions on GCP Cloud. Ability to understand business...

  • Data Engineer

    4 days ago

    Kollam, India Add Min Web World Full time

    Job Title: Data Engineer (Qlik Experience)Location: Mohali (On-site)Experience: Minimum 2 YearWorking Days: 5 Days a WeekJob Description:We are looking for a dedicated Data Engineer who has hands-on experience working with Qlik and other data tools. The ideal candidate should have a strong understanding of data processing, integration, and reporting, along...

  • Python API + Data Engineer

    2 weeks ago

    Kollam, India Digitrix Software LLP Full time

    Experience : 5 to 8 yearsJob description:Python API + Data EngineerWe are looking for aself-motivated Python Data Engineerwith strong skills inbackend/API development and large-scale data processing , who can work independently and thrive in a fast-paced, agile environment.Key ResponsibilitiesDesign, develop, and optimizedata pipelinesusingPySpark, AWS Glue,...

  • Data integration reliability and devops engineer

    4 weeks ago

    Kollam, India RapidBrains Full time

    Job Title: Data Integration Reliability & Dev Ops Engineer Experience: 7–10 Years Location: Remote Contract Duration: Long Term Work Time: Normal IST (with 2–3 hours overlap as per client need)We are seeking a highly skilled Data Integration Reliability & Dev Ops Engineer to join our team. This role focuses on maintaining the operational reliability and...