Freelance Data Engineer

1 week ago

Mount Abu, India upGrad Full time

We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a modern, cloud-native data stack. You'll play a crucial role in transforming raw data into actionable insights, ensuring data quality, and maintaining the infrastructure required for seamless data flow.Key ResponsibilitiesDevelop, construct, test, and maintain robust and scalable large-scale ETL pipelines using PySpark for processing and Apache Airflow for workflow orchestration.Design and implement both Batch ETL and Streaming ETL processes to handle various data ingestion requirements.Build and optimize data structures and schemas in cloud data warehouses like AWS Redshift.Work extensively with AWS data services, including AWS EMR for big data processing, AWS Glue for serverless ETL, and Amazon S3 for data storage.Implement and manage real-time data ingestion pipelines using technologies like Kafka and Debezium for Change Data Capture (CDC).Interact with and integrate data from various relational and NoSQL databases such as MySQL, PgSQL (PostgreSQL), and MongoDB.Monitor, troubleshoot, and optimize data pipeline performance and reliability.Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver high-quality, reliable data solutions.Ensure data governance, security, and quality across all data platforms.Required Skills & QualificationsTechnical SkillsExpert proficiency in developing ETL/ELT solutions using PySpark.Strong experience in workflow management and scheduling tools, specifically Apache Airflow.In-depth knowledge of AWS data services including:AWS EMR (Elastic MapReduce)AWS GlueAWS RedshiftAmazon S3Proven experience implementing and managing data streams using Kafka.Familiarity with Change Data Capture (CDC) tools like Debezium.Hands-on experience with diverse database technologies: MySQL, PgSQL, and MongoDB.Solid understanding of data warehousing concepts, dimensional modeling, and best practices for both batch and real-time data processing.Proficiency in a scripting language, preferably Python.General QualificationsBachelor’s or Master’s degree in Computer Science, Engineering, or a related field.Excellent problem-solving, analytical, and communication skills.Ability to work independently and collaboratively in a fast-paced, dynamic environment.Nice to Have (Preferred Skills)Experience with Infrastructure as Code (e.g., Terraform, CloudFormation).Knowledge of containerization technologies (Docker, Kubernetes).Familiarity with CI/CD pipelines.

  • Freelance ML Engineer | Speech Model Training, Quantization

    2 days ago

    Mount Abu, India eniac Full time

    Job Descriptiongeteniac.tech is looking for a freelance Machine Learning Engineer to help train, optimize, and deploy speech models for client projects.You’ll work on preparing and serving customized speech-to-text and text-to-speech models, ensuring low latency, high reliability, and seamless integration into production environments.ResponsibilitiesTrain...

  • Data Engineer

    1 week ago

    Mount Abu, India Forage AI Full time

    Experience Level: Data Engineer- 3- 7 years of relevant experience in data engineering.About Forage AI: Forage AI is a pioneering AI-powered data extraction and automation company that transforms complex, unstructured web and document data into clean, structured intelligence. Our platform combines web crawling, NLP, LLMs, and agentic AI to deliver highly...

  • Data Engineer with Databricks

    1 week ago

    Mount Abu, India KPG99 INC Full time

    Job Title: Databricks Engineer Location: RemoteDuration: 12 months Contract with extensions Job Description: REQUIRED SKILLS AND EXPERIENCE- 3–5 years of experience in data engineering roles - Strong hands-on experience with Databricks for data processing and pipeline development. - Proficiency in SQL for data querying, transformation, and troubleshooting....

  • Cloud Data Engineer

    2 days ago

    Mount Abu, India Lemongrass Full time

    About LemongrassLemongrass is a software-enabled services provider, synonymous with SAP on Cloud, focused on delivering superior, highly automated Managed Services to Enterprise customers. Our customers span multiple verticals and geographies across the Americas, EMEA and APAC. We partner with AWS, SAP, Microsoft and other global technology leaders.We are...

  • Senior Data Engineer

    4 days ago

    Mount Abu, India Globex Digital Full time

    Data Engineer RoleLocation: India RemoteAre you a passionate Data Engineer ready to design and build cutting-edge, scalable, and reliable ML/AI solutions? Join our dynamic cross-functional feature team in India and drive innovation from concept to industrialization. We're looking for an expert to integrate and optimize algorithms across the entire product...

  • Freelance Digital Strategist

    3 days ago

    Mount Abu, India nicheBrains Full time

    Industry: Textile Manufacturing Location: Hyderabad Employment Type: Contract (Remote)Company Description: nicheBrains is a modern digital transformation platform focused on empowering Micro, Small, and Medium Enterprises (MSMEs). Our platform connects business leaders from the textile industry with vetted experts to accelerate growth, innovation, and...

  • Full stack data

    2 weeks ago

    Mount Abu, India ContexQ Full time

    Senior Full Stack Data Engineer – Enterprise Analytics PlatformLocation: Remote (Preference for India-based candidates)Compensation: Competitive salary + significant equity packageCompany: Contex Q (Singapore HQ)About Contex QContex Q, a Singapore-based B2 B Saa S AI startup, is dedicated to transforming financial crime, fraud, and risk management through...

  • Senior AWS Data Engineer

    3 weeks ago

    Mount Abu, India Lean IT Inc. Full time

    Company DescriptionLean IT Inc. is at the forefront of the technological revolution, with a proven track record of delivering state-of-the-art cloud solutions to a diverse clientele. As an official Salesforce Ridge Partner, we specialize in expert consultations, robust and customizable Salesforce solutions, and seamless API integrations. Our core...

  • Social Media Data Engineer

    1 week ago

    Mount Abu, India Deeter Investments LLP Full time

    NOTE: IF YOU HAVE NO EXPERIENCE AQUIRING BULK SOCIAL MEDIA DATA DO NOT APPLY-Please explain your relevant experience clearly at the TOP of your CV. If you do not you will not be considered About Deeter InvestmentsDeeter Investments is a founder-led proprietary trading firm built around real-time, data-driven decision-making. We prize curiosity,...

  • Lead Data Architect

    1 week ago

    Mount Abu, India ACL Digital Full time

    Technology Skills and Project Experience:12 years of experience in modeling and business system designs.10 years hands on experience as Data Engineer/Architect with proven experience on Big Data and Data Lakes on AWS7 years of experience in below TechnologiesScripts/Programming language: SQL, Python, PROC, Windows FunctionsGitHubAWS: S3, RedShift, GlueBig...