
Data Engineer(Remote)
2 weeks ago
Summary
Python + Airflow + Snowflake Data Engineer
We are seeking a highly skilled Python / Airflow Data Engineer with 7 to 8 years of experience,
specifically with a strong background in AWS technologies. The ideal candidate will have a
deep understanding of Apache Airflow and its integration within AWS ecosystem, enabling
efficient data pipeline orchestration and management.
Responsibilities
- Design, develop, and maintain complex data pipelines using Python for efficient data
processing and orchestration.
- Collaborate with cross-functional teams to understand data requirements and
architect robust solutions within the AWS environment.
- Implement data integration and transformation processes to ensure optimal
performance and reliability of data pipelines.
- Optimize and fine-tune existing data pipelines / Airflow to improve efficiency,
scalability, and maintainability.
- Troubleshoot and resolve issues related to data pipelines, ensuring smooth
operation and minimal downtime.
- Work closely with AWS services like S3, Glue, EMR, Redshift, and other related
technologies to design and optimize data infrastructure.
- Develop and maintain documentation for data pipelines, processes, and system
architecture.
- Stay updated with the latest industry trends and best practices related to data
engineering and AWS services.
Requirements
Bachelor's degree in Computer Science, Engineering, or a related field.
Proficiency in Python, PySpark and SQL for data processing and manipulation.
Min 5 years of experience in data engineering, specifically working with Apache
Airflow and AWS technologies.
- Strong knowledge of AWS services, particularly S3, Glue, EMR, Redshift, and AWS
Lambda.
Understanding of Snowflake Data Lake is preferred.
Experience with optimizing and scaling data pipelines for performance and
efficiency.
- Good understanding of data modeling, ETL processes, and data warehousing
concepts.
- Excellent problem-solving skills and ability to work in a fast-paced, collaborative
environment.
- Effective communication skills and the ability to articulate technical concepts to
non-technical stakeholders.
Preferred Qualifications:
AWS certification(s) related to data engineering or big data.
Experience working with big data technologies like Snowflake, Spark, Hadoop, or
related frameworks.
Familiarity with other data orchestration tools in addition to Apache Airflow.
Knowledge of version control systems like Bitbucket, Git.
Job Types: Full-time, Contractual / Temporary
Pay: ₹500, ₹1,841,614.32 per year
Work Location: Remote
-
Azure AI Data Engineer
1 week ago
Remote, India Data PlatformExperts Full time ₹ 70,000 - ₹ 15,00,000 per yearJob Description:We are looking for a skilled and motivated AI Azure Data Engineer with strong expertise in Microsoft Azure data services. The ideal candidate must have hands-on experience with Databricks or Microsoft Fabric and hold a valid certification in either. You will be responsible for designing, developing, and deploying scalable data pipelines,...
-
GIS Data Intern
4 days ago
Remote, India Engineer Philosophy Web Services Pvt Ltd Full time ₹ 88,800 - ₹ 14,40,000 per yearJob Title: GIS Data Intern (Freshers Welcome)Company: Engineer Philosophy Web Services Pvt. Ltd.Location: Indore, Madhya Pradesh (Remote)Job Type: Internship / Full-timeJob Description:Engineer Philosophy Web Services Pvt. Ltd. is seeking a motivated and detail-oriented GIS Data Intern to join our Indore-based team. This internship provides hands-on...
-
Data Scientist
2 weeks ago
Remote, India Applied Data Finance Full timeAbout the Role **Responsibilities**: - Conduct deep-dive analyses to uncover insights on user behaviour, marketing performance, and product engagement. - Create clear, concise dashboards and reports to communicate findings to stakeholders. - Partner with product managers, marketers, and engineers to design experiments and evaluate their outcomes. -...
-
Data Scientist
2 weeks ago
Remote, India Applied Data Finance Full timeAbout the Role **Responsibilities**: - Conduct deep-dive analyses to uncover insights on user behaviour, marketing performance, and product engagement. - Create clear, concise dashboards and reports to communicate findings to stakeholders. - Partner with product managers, marketers, and engineers to design experiments and evaluate their outcomes. -...
-
Azure Data Architect
7 days ago
Remote, India Data PlatformExperts Full time**Job Description: Azure Data Architect** **Key Responsibilities**: - **Design and Implementation**: - Design and implement end-to-end data solutions (data models, pipelines, data lakes, data warehouses) in Azure. - Optimize and maintain existing Azure data structures and integration processes. - Ensure architectural solutions are scalable, maintainable,...
-
Data Entry remote
1 week ago
Remote, India Spectrum NJ Full time**Remote with Time Doctor (Hour Capture and Screen Capture is Mandatory on PC)** DO NOT SUBMIT RESUME IF YOU DO NOT AGREE TO THIS. **Full Job Description** Join our fast growing company! We are looking to add an efficient, hard working individual that will excel in our eCommerce department. We are looking for a full time eCommerce data entry/sales...
-
Data Engineer
4 days ago
Remote, India Galactix Solutions Full time ₹ 2,00,000 - ₹ 3,00,000 per yearJob Title: Data EngineerLocation: RemoteJob Type: Remote ( Freelance )Experience Level: 4 to 8 yearsSend resumes to : About the Role:We are seeking a highly skilled and motivated Data Engineer to design, build, and maintain scalable and reliable data pipelines. You will work closely with data analysts, data scientists, and software engineers to ensure clean,...
-
Fabric Data Engineer
2 weeks ago
Remote, India Intellion Technologies Pvt Ltd Full time ₹ 3,00,000 - ₹ 3,60,000 per yearJob Title: Fabric Data Engineer (Part-time | Freelance | Remote)Job Description:We are looking for a Fabric Data Engineer with a strong background in modern data engineering practices to provide job support on a part-time freelance basis. The ideal candidate should have solid expertise in data layer concepts, Spark, and SQL.Responsibilities:Support ongoing...
-
Data engineer
1 week ago
Remote, India INNONEXIS TECHNOLOGY PRIVATE LIMITED Full time ₹ 4,80,000 - ₹ 6,00,000 per yearWe're Hiring: Freelance Data EngineerWe are looking for a talented Freelance Data Engineer to help us design, build, and optimize scalable data pipelines and platforms. Key Responsibilities:Design, develop, and maintain ETL pipelines and workflowsWork with structured and unstructured data across multiple sourcesImplement and optimize data solutions on AWS...
-
Data Engineer
2 weeks ago
Remote, India ixceed Full time ₹ 1,20,000 - ₹ 12,00,000 per yearRole: Snowflake Data EngineerLocation: Remote in IndiaMode: PermanentJob Description:More than 5 years of overall ExperiencePrimary Skills: 3-4 Years exp per skillAzure Data FactorySnowflakeData ModelingSQLPythonSecondary Skills:SnowpipeSnowparkSnowflake Streams and TasksDatabricksDBTVery strong communication skillsPractical experiences in requirements...