Freelance data engineer

2 days ago

Aligarh, India UpGrad Full time

We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a modern, cloud-native data stack. You'll play a crucial role in transforming raw data into actionable insights, ensuring data quality, and maintaining the infrastructure required for seamless data flow.Key ResponsibilitiesDevelop, construct, test, and maintain robust and scalable large-scale ETL pipelines using Py Spark for processing and Apache Airflow for workflow orchestration.Design and implement both Batch ETL and Streaming ETL processes to handle various data ingestion requirements.Build and optimize data structures and schemas in cloud data warehouses like AWS Redshift.Work extensively with AWS data services, including AWS EMR for big data processing, AWS Glue for serverless ETL, and Amazon S3 for data storage.Implement and manage real-time data ingestion pipelines using technologies like Kafka and Debezium for Change Data Capture (CDC).Interact with and integrate data from various relational and No SQL databases such as My SQL, Pg SQL (Postgre SQL), and Mongo DB.Monitor, troubleshoot, and optimize data pipeline performance and reliability.Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver high-quality, reliable data solutions.Ensure data governance, security, and quality across all data platforms.Required Skills & QualificationsTechnical SkillsExpert proficiency in developing ETL/ELT solutions using Py Spark.Strong experience in workflow management and scheduling tools, specifically Apache Airflow.In-depth knowledge of AWS data services including:AWS EMR (Elastic Map Reduce)AWS GlueAWS RedshiftAmazon S3Proven experience implementing and managing data streams using Kafka.Familiarity with Change Data Capture (CDC) tools like Debezium.Hands-on experience with diverse database technologies: My SQL, Pg SQL, and Mongo DB.Solid understanding of data warehousing concepts, dimensional modeling, and best practices for both batch and real-time data processing.Proficiency in a scripting language, preferably Python.General QualificationsBachelor’s or Master’s degree in Computer Science, Engineering, or a related field.Excellent problem-solving, analytical, and communication skills.Ability to work independently and collaboratively in a fast-paced, dynamic environment.Nice to Have (Preferred Skills)Experience with Infrastructure as Code (e.g., Terraform, Cloud Formation).Knowledge of containerization technologies (Docker, Kubernetes).Familiarity with CI/CD pipelines.

  • Sr Data Engineer

    4 weeks ago

    Aligarh, India Accion Labs Full time

    Job Description / Skill set:Data Engineer / Data Analyst (Hybrid Role) Data Analysis: Python, Pandas, NumPy, Strong SQL, EDA techniques, Data Visualization Tools, Statistical KnowledgeData Engineering: SQL, ETL pipelines, Airflow, Spark (Optional)Data Warehouse: AWS Redshift/ GCP BigQueryStatistical Insight: Ability to assess data quality and completeness...

  • Data engineer

    2 days ago

    Aligarh, India Everise Full time

    Company OverviewJoin us on our mission to elevate customer experiences for people around the world. As a member of the Everise family, you will be part of a global experience company that believes in being people-first, celebrating diversity and incubating innovation. Our dedication to our purpose and people is being recognized by our employees and the...

  • Excel power query

    6 days ago

    Aligarh, India JS Accounting Services Full time

    Excel Power Query & VBA Expert (Consolidation Template Developer) ObjectiveWe are seeking an experienced Excel Modeller and Power Query & VBA Expert on a contract/freelance basis for approx. 10-12 hours every week. Together with our group accounting experts, you will design, develop, and implement a dynamic, Power Query–driven Excel consolidation system...

  • Generative AI Engineer

    4 weeks ago

    Aligarh, India Neurones IT Asia Full time

    We are looking to onboard a GenAI/ML engineer who will drive the development of GenAI activities globally and bring expertise to leverage Large Language Models (LLMs) across languages and modalities for clients' AI-driven products.You will be responsible forBuilding and integrating generative AI applications for customer interactions by using LLMs and...

  • Big data engineer – azure

    4 days ago

    Aligarh, India Innova ESI Full time

    Role: Big Data Engineer – AzureExperience: 10+ YearsLocation: Bangalore Immediate Joiners OnlyBig Data :Mandatory Skills:Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big DataOptional Skills: Airflow, PythonRoles & ResponsibilitiesOverall, experience in IT industry, including 5 years in...

  • Data Scientist

    4 weeks ago

    Aligarh, India Impetus Full time

    About ImpetusImpetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.Founded in 1991, we are cloud and data engineering leaders providing solutions...

  • Senior Data Engineer

    6 days ago

    Aligarh, India Amicon Hub Services Full time

    Must Have Skills:1. Strong expertise in SQL (complex queries, optimization, data modeling).2. Hands-on experience with SSAS (SQL Server Analysis Services).3. Deep understanding of OLAP cubes and multidimensional data models.4. Experience working with BI tools (e.g., Power BI, Tableau, or equivalent).

  • AI & Data Architect

    4 weeks ago

    Aligarh, India CloudFronts - Microsoft Solutions Partner Full time

    AI & Data ArchitectJob Summary:AI & Data Architect will lead all aspects of AI, Business Intelligence, and Data Architecture with expertise in Azure services, including AI/ML solutions, data engineering, and analytics. The role involves designing, configuring, and managing BI services, aggregating data from multiple sources into a data warehouse,...

  • Field executive

    2 days ago

    Aligarh, Uttar Pradesh, India Asian Skills And Training Pvt. Ltd. Full time ₹ 1,80,000 - ₹ 2,40,000 per year

    KYC verification of customer's data , Background verification, address verification.Job Type: FreelanceContract length: 12 monthsPay: ₹15, ₹20,000.00 per monthEducation:Higher Secondary(12th Pass) (Preferred)Experience:total work: 1 year (Preferred)Language:Hindi (Preferred)License/Certification:Driving Licence (Preferred)Work Location: In person

  • Senior Data

    5 days ago

    Aligarh, India Kooner Transport Group - KTG Full time

    Location: Remote/ Uttarakhand - Ramnagar Office Type: 3-Month Contract (extendable based on performance) Work Hours: Must overlap 3–4 hours/day with Eastern Time (Canada) Compensation: ₹100,000 – ₹150,000 INR per month (depending on skill & experience)About the RoleKooner Transport Group (Canada) operates a large cross-border trucking fleet with over...