
Freelance Data Engineer – Python
4 weeks ago
Company Description
ThreatXIntel is a startup cyber security company that focuses on protecting businesses and organizations from cyber threats. Our team offers various services, such as cloud security, web and mobile security testing, and DevSecOps. We aim to deliver customized and affordable solutions tailored to meet the specific needs of our clients, ensuring that businesses of all sizes have access to high-quality cyber security services.
Role Description
We are seeking an experienced Freelance Data Engineer with strong expertise in Python and AWS services (S3, Glue, Step Functions, PySpark) to design, develop, and optimize data pipelines. The role also requires proficiency in pytest for testing, Git/GitHub for version control, and clear technical documentation.
Key Responsibilities
- Design and develop data pipelines using AWS Glue, PySpark, and Step Functions.
- Implement ETL/ELT processes for ingesting, transforming, and delivering data from multiple sources.
- Manage and optimize storage solutions with Amazon S3.
- Write reusable and scalable Python code for data engineering workflows.
- Implement unit and integration tests using pytest to ensure data quality and pipeline reliability.
- Collaborate using Git/GitHub for version control, code reviews, and CI/CD integration.
- Create clear technical documentation for pipelines, workflows, and design decisions.
- Troubleshoot and resolve issues related to data pipelines and AWS services.
Qualifications
- 5–10 years of data engineering experience, with at least 5 years in AWS ecosystem.
- Strong coding skills in Python with experience in PySpark.
- Hands-on experience with AWS Glue, Step Functions, and S3.
- Proficiency in pytest for test automation.
- Solid understanding of Git/GitHub workflows.
- Strong communication skills with a focus on documentation and knowledge sharing.
-
Data Engineer
3 weeks ago
Ajmer, Rajasthan, India InCommon Full timeExperience: 3–6 yearsLocation: Remote (India)Engagement: Full-Time Employment / ContractorAbout the ProjectInCommon is hiring on behalf of Podifi to support a Fortune 500 client on a large-scale database migration initiative. The project involves transitioning from Fivetran to Nexla, with Snowflake as the target data platform. This role is critical for...
-
Data Engineer
3 weeks ago
Ajmer, Rajasthan, India Selector Full timeAbout Us----------Selector is building an operational intelligence platform for digital infrastructure. By adoptingan AI/ML-based analytics approach, the platform provides actionable multi-dimensionalinsights to network, cloud, and application operators. It enables operations teams to meettheir KPIs through seamless collaboration, search-driven...
-
Big Data Developer
4 weeks ago
Ajmer, Rajasthan, India Kresta Softech Private Limited Full timeRole Highlights:Position: Big Data EngineerExperience: 2+ yearsLocation: Hyderabad, Chennai- HybridNotice Period: Immediate/7 days joiners mandateJob Overview:Must have skills- Big Data, Scala, AWS and Python or Java
-
Data Analyst
4 weeks ago
Ajmer, Rajasthan, India Canopus Infosystems - A CMMI Level 3 Company Full timePosition: Data AnalystExperience: 2+ YearsLocation: RemoteJoining: Immediate Joiners PreferredAbout the Role:We are looking for a skilled Data Analyst with strong Python expertise and hands-on experience in handling large datasets, data cleaning, analysis, and visualization. The ideal candidate should be capable of building data pipelines, performing...
-
Senior Data Engineer
3 weeks ago
Ajmer, Rajasthan, India Quantiphi Full timeRole: Senior Data EngineerExperience Level: 4 to 7 YearsWork location: Mumbai/Bangalore (Hybrid)Required Skills:● Bachelor's degree in Computer Science or similar field or equivalent work experience.● 3+ years of experience on Data Warehousing, Data Engineering or Data Integration projects.● Expert with data warehousing concepts, strategies, and...
-
Junior Web Crawling Engineer
4 weeks ago
Ajmer, Rajasthan, India Forage AI Full timeWe are seeking a Junior Web Crawling Engineer who will be responsible for building and maintaining web crawlers, extracting valuable insights from the web, and ensuring data quality. The ideal candidate will have strong Python programming skills and experience in web scraping frameworks, browser automation tools, and handling anti-scraping mechanisms. About...
-
Database Engineer
3 weeks ago
Ajmer, Rajasthan, India CodeVyasa Full timeRole OverviewWe are seeking a highly skilled and motivated Database developer || Bangalore with 6+ years of experience. If you're passionate about coding, problem-solving, and innovation, we'd love to hear from youAbout UsCodeVyasa is a mid-sized product engineering company that works with top-tier product/solutions companies such as McKinsey, Walmart,...
-
Data Scientist
4 weeks ago
Ajmer, Rajasthan, India Delta System & Software, Inc. Full time7+ years of experience as a Business Analyst or Product Analyst, with at least 2 years in AI/ML or Generative AI-related initiatives.5+ Yrs experience in Data Science (Python)Proven experience in the Asset and Wealth Management industry (e.g., portfolio management, compliance, AML, KYC, client onboarding, investment advisory).Familiarity with AI tools,...
-
Data Mining Analyst
3 weeks ago
Ajmer, Rajasthan, India NuvoRetail Full timePosition: Data Mining AnalystPlease Note: Only Candidates with 2-3 years of experience should apply.This is a Delhi-based position and work from office onlyWork Location: Sector 23 Dwarka, DelhiWe are seeking a skilled Data Mining Analyst with expertise in automating data extraction processes from web platforms. The ideal candidate will be experienced in...
-
Senior Software Engineer, Reliability
4 weeks ago
Ajmer, Rajasthan, India LinkedIn Full timeis the world's largest professional network, built to help members of all backgrounds and experiences achieve more in their careers. Our vision is to create economic opportunity for every member of the global workforce. Every day our members use our products to make connections, discover opportunities, build skills and gain insights. We believe amazing...