Freelance Data Engineer
5 days ago
We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a modern, cloud-native data stack. You'll play a crucial role in transforming raw data into actionable insights, ensuring data quality, and maintaining the infrastructure required for seamless data flow.Key ResponsibilitiesDevelop, construct, test, and maintain robust and scalable large-scale ETL pipelines using PySpark for processing and Apache Airflow for workflow orchestration.Design and implement both Batch ETL and Streaming ETL processes to handle various data ingestion requirements.Build and optimize data structures and schemas in cloud data warehouses like AWS Redshift.Work extensively with AWS data services, including AWS EMR for big data processing, AWS Glue for serverless ETL, and Amazon S3 for data storage.Implement and manage real-time data ingestion pipelines using technologies like Kafka and Debezium for Change Data Capture (CDC).Interact with and integrate data from various relational and NoSQL databases such as MySQL, PgSQL (PostgreSQL), and MongoDB.Monitor, troubleshoot, and optimize data pipeline performance and reliability.Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver high-quality, reliable data solutions.Ensure data governance, security, and quality across all data platforms.Required Skills & QualificationsTechnical SkillsExpert proficiency in developing ETL/ELT solutions using PySpark.Strong experience in workflow management and scheduling tools, specifically Apache Airflow.In-depth knowledge of AWS data services including:AWS EMR (Elastic MapReduce)AWS GlueAWS RedshiftAmazon S3Proven experience implementing and managing data streams using Kafka.Familiarity with Change Data Capture (CDC) tools like Debezium.Hands-on experience with diverse database technologies: MySQL, PgSQL, and MongoDB.Solid understanding of data warehousing concepts, dimensional modeling, and best practices for both batch and real-time data processing.Proficiency in a scripting language, preferably Python.General QualificationsBachelor’s or Master’s degree in Computer Science, Engineering, or a related field.Excellent problem-solving, analytical, and communication skills.Ability to work independently and collaboratively in a fast-paced, dynamic environment.Nice to Have (Preferred Skills)Experience with Infrastructure as Code (e.g., Terraform, CloudFormation).Knowledge of containerization technologies (Docker, Kubernetes).Familiarity with CI/CD pipelines.
-
bangalore, India ThreatXIntel Full timeCompany Description ThreatXIntel is a startup dedicated to providing customized and affordable cyber security solutions to businesses and organizations of all sizes. We specialize in cloud security, web and mobile security testing, cloud security assessment, and DevSecOps. Our proactive approach monitors and identifies potential vulnerabilities to ensure the...
-
bangalore, India ThreatXIntel Full timeCompany Description ThreatXIntel is a startup dedicated to providing customized and affordable cyber security solutions to businesses and organizations of all sizes. We specialize in cloud security, web and mobile security testing, cloud security assessment, and DevSecOps. Our proactive approach monitors and identifies potential vulnerabilities to ensure the...
-
Freelance Data Engineer
5 days ago
bangalore, India upGrad Full timeWe are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a modern, cloud-native data stack. You'll play a crucial role in transforming raw data into actionable insights, ensuring data...
-
Freelance FullStack Engineer
3 days ago
bangalore, India Leading MNC Full timeLooking for a Freelance FullStack Engineer to join a team of rockstar developers. The candidate should have a minimum of 5+ yrs. of experience.There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report...
-
Freelance FullStack Engineer
2 days ago
bangalore, India Leading MNC Full timeLooking for a Freelance FullStack Engineer to join a team of rockstar developers. The candidate should have a minimum of 5+ yrs. of experience. There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report...
-
Freelance Medical Writer
7 days ago
bangalore, India MIRA Healthcare Full time🚨 Hiring: Freelance Medical Writer (Scientific & Clinical Research Focus)Mira Healthcare is looking for a freelance medical writer to assist in drafting and editing scientific papers, primarily focused on nutraceuticals, probiotics, and microbiology-based research, as well as clinical trials involving nutraceutical interventions.🧠 Role...
-
Freelance Musician
3 days ago
Bangalore, India Turing Full timeAbout Turing: Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems. Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM, and...
-
Freelance Trainer- Facility Management
4 weeks ago
Bangalore, India Acelot Innovation Private Limited Full timeJob Title: Freelance Trainers - Blue-Collar Workforce (Integrated Facility Management Industry)About the Role We are seeking experienced and dynamic freelance trainers to conduct technical training programs for blue-collar employees in the Integrated Facility Management (IFM) sector. The trainers will deliver structured, impactful training sessions for...
-
bangalore, India AiVONIC Technology PVT LTD Full timeSolution Architect Freelancer About the Role Application Modernization & Stabilisation We are seeking an experienced Solution Architect (Freelance/Contract) to analyze the current environment of our client’s mobile and web applications, identify critical issues, propose architectural improvements, and lead the execution of stabilization and modernization...
-
Infographic/Graphic Designer Freelance
2 weeks ago
bangalore, India Cipher Research Full timeCompany Description Cipher Research started with a simple frustration: crypto has world-changing ideas, but no one can explain them clearly. Built by a team of researchers, storytellers, and designers, Cipher Research turns complex blockchain tech into stories people understand and remember. In just one year, we’ve collaborated with some of the biggest...
