AWS Data Engineer
2 months ago
Job Position: AWS Data Engineer
Job Type: Full-Time
Location: Kolkata, IN
Experience: - 4+ to 10+ Years
Must Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, DynamoDB, Python, PySpark, SQL, PL/SQL.
Key Responsibilities:
- Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step Functions to facilitate ETL (Extract, Transform, Load) processes and ensure data integrity and accessibility.
- Data Storage Management: Utilize Amazon S3 for scalable and secure data storage. Optimize data storage solutions and manage data lifecycle policies to ensure efficient data retrieval and cost management.
- Data Transformation and Processing: Develop and execute data transformation workflows using AWS Glue and PySpark. Ensure data is processed efficiently and accurately to meet business requirements.
- Database Management: Manage and optimize relational and NoSQL databases using Amazon RDS and DynamoDB. Implement data models and design schemas to support business applications and reporting needs.
- Scripting and Automation: Write Python scripts to automate data processing tasks, integrate data from various sources, and develop custom solutions for data manipulation and analysis.
- SQL and PL/SQL Development: Utilize SQL for querying relational databases and performing complex data manipulations. Apply PL/SQL for advanced database procedures and optimizations in Oracle environments.
- Data Quality and Performance: Monitor and maintain data quality, performance, and security. Implement best practices for data management and troubleshoot issues to ensure reliable data operations.
- Collaboration and Documentation: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide technical expertise. Document data pipelines, processes, and architecture to support ongoing maintenance and scalability.
Required Skills and Qualifications:
- Proven experience as a Data Engineer or similar role with a focus on AWS technologies.
- Strong proficiency in AWS services including S3, Lambda, Glue, Step Functions, RDS, and DynamoDB.
- Expertise in Python and PySpark for data processing and automation tasks.
- Solid experience with SQL and PL/SQL for querying and managing relational databases.
- Demonstrated ability to design and implement data pipelines and workflows.
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration abilities.
Qualifications:
Bachelor’s degree in computer science, Information Technology, or a related field.
-
AWS Data Engineer
1 month ago
surat, India Tata Consultancy Services Full timeDear Candidate,Greetings from TCS Human Resources Team!!Job Role: AWS Data EngineerJob Locations: HyderabadExperience Range: 7 to 10 yearsJob Description:-Key Responsibilities: Lead the design, implementation, and optimization of data pipelines and architectures using AWS services like S3, Redshift, Glue, Lambda, and Step Functions. Architect data solutions...
-
Data Engineer Position
2 weeks ago
Surat, Gujarat, India Huptech HR Solutions Full timeJob Title: Data Engineer PositionJob Summary: We are seeking a highly skilled Data Engineer to join our team at Huptech HR Solutions. The ideal candidate will have a strong background in designing, developing, and maintaining scalable and efficient data pipelines using industry-standard tools and technologies.Responsibilities:Data Pipeline Development:...
-
Data Scientist
5 months ago
Surat, Gujarat, India Blue Data Consulting Full time**Data Scientist** **Key Responsibilities**: - Develop and implement NLP solutions for text analysis, sentiment analysis, and language understanding. - Utilize Python programming for data manipulation, model building, and data visualization tasks. - Collaborate with cross-functional teams to integrate data science solutions into cloud environments,...
-
AWS Devops Engineer
1 month ago
surat, India Tata Consultancy Services Full timeGreetings from TCS!!Job Title: AWS Devops EngineerWalkin interview @TCS HyderabadDate: 19 OCT 24Mode: Physical Walkin drive (face to face)Experience Range: 6-10 YearsMinimum Qualification:15 years of full-time educationJob Description:Role: AWS Devops EngineerSkill : AWS,Devops,Jenkins.Ansible,Terraform• Main Skills –Experience working on Linux based...
-
Data Engineering Specialist
3 weeks ago
Gujarat/Nagpur/Surat/Vadodara/Baroda, India TrekW Full timeTrekW Data Engineering Role Job Overview :Data Engineers at TrekW play a critical role in developing, implementing, and maintaining scalable data engineering solutions to support the company's data initiatives. This position requires strong experience in data engineering, including data ingestion, transformation, storage, and data pipeline...
-
Trainer for Machine Learning Operations
6 months ago
Surat, Gujarat, India Blue Data Consulting Full time**Key responsibilities**: - Design and implement cloud solutions, build MLOps on cloud (AWS, Azure, or GCP) - Build CI/CD pipelines orchestration by GitLab CI, GitHub Actions, Circle CI, Airflow or similar tools - Data science model review, run the code refactoring and optimization, containerization, deployment, versioning, and monitoring of its quality -...
-
Backend Developer Node AWS RestAPI
4 weeks ago
Surat, India Feufo Inc Full timeJob Title: Backend Developer (Node.js) Location: Fully remote job Company Description: Feufo specializes in temporary permanent contract and remote staffing across various industries including healthcare manufacturing IT finance and oil & gas. They offer tailored solutions for shortterm projects fulltime positions executive searches and international...
-
Data Engineer
1 month ago
Gujarat/Nagpur/Surat/Vadodara/Baroda, India TrekW Full timeJob Description : Data EngineerResponsibilities :- Develop, implement, and maintain efficient and scalable data engineering solutions to support the company's data initiatives.- Collaborate with cross-functional teams to understand business requirements and translate them into technical data engineering solutions.- Build and maintain data pipelines to...
-
Data Science Engineer
2 weeks ago
Gujarat/Nagpur/Surat/Vadodara/Baroda, India TrekW Full timeAbout the RoleThe Data Engineer will be responsible for developing and maintaining efficient data engineering solutions to support the company's data initiatives. This includes designing and implementing data pipelines to ingest, transform, and store data from various sources, ensuring data quality, integrity, and reliability.The ideal candidate will have...
-
Scala Data Engineer
24 hours ago
Surat, India Essvee Consultant Full timeProfile : Scala Data Engineer / Sr. Data Engineer | Location: Mumbai | Experience: 5 or 5+ years | Budget : 10 to 15lac | Hybrid Job |Note: If you want your CV shortlisted, Copy, Paste and fill out the below form for a better response.Scala Data Engineer / Sr. Data Engineer Skills: Spark, Data Bricks, Azure, Azure Data, SQL, Services, Databricks, Data...
-
Senior Data Engineer
5 days ago
surat, India Deltacubes Full timeRequirementsBachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or a related field.Experience with Microsoft Fabric or similar cloud-based data integration platforms is a must.10+ years of experience in data engineering, with a strong focus on ETL development using PySpark or other Spark-based tools.Proficiency in SQL with...
-
Data Architect
6 months ago
Adajan, Surat, Gujarat, India Aloola Solutions Pvt Ltd Full timeWe are seeking an adept Sr. Data Architect to join our team. As a Data Architect, you will be pivotal in the entire project lifecycle, from conceptualization to completion, focusing on client-based projects that involve strategy and data governance. This position offers an exceptional opportunity for strategic data modeling that aligns to work in a...
-
Senior Data Engineer
2 weeks ago
Surat, Gujarat, India Technocruitx Universal Services Pvt. Ltd. Full timeAbout This Role:We are seeking a skilled Senior Data Engineer to join our team at Technocruitx Universal Services Pvt. Ltd.As a focused professional, you will be responsible for extracting and ingesting data from websites using web crawling tools. Your expertise in Python and JavaScript will be instrumental in creating scalable and efficient data extraction...
-
Microsoft Fabric Data Engineer
2 weeks ago
Surat, Gujarat, India VNB Consulting Services Full timeData Engineering Role OverviewAs a Data Engineer at VNB Consulting Services, you will play a critical role in designing, implementing, and supporting data warehousing and business intelligence solutions. This involves using Microsoft Fabric technologies to build scalable and efficient data pipelines for seamless data ingestion, transformation, and loading...
-
Surat, India BigRio Full timeJob Title: AI and Gen. AI Data Scientist and Data EngineersLocation: India, Remote Part time/Consulting About BigRio:BigRio is a remote-based, technology consulting firm with headquarters in Boston, MA. We deliver software solutions ranging from: custom development, software implementation, data analytics, and machine learning/AI integrations. We are a...
-
Microsoft Fabric Data Engineer
2 weeks ago
Surat, India VNB Consulting Services Full timeMicrosoft Fabric Data EngineerLocation: Remote/Work from OfficeExperience: 3-5 yearsAbout Us:VNB Consulting Services, headquartered in New Jersey, is an end-to-end technology solution provider specializing in Apps, Automation, Analytics, and AI. Our mission is to deliver tested technology solutions that enhance existing technology, improve business...
-
Senior Data Engineer
2 weeks ago
Surat, Gujarat, India System Soft Technologies Full timeJob SummaryWe are seeking a highly skilled Data Engineer to drive our data strategy by transforming complex datasets into actionable insights.Key ResponsibilitiesDesign, develop, and maintain robust data pipelines across SQL, Hadoop, and Snowflake environments.Perform data transformations in EAP using Spark and Scala and ensure seamless data movement to...
-
Data Scientist
6 months ago
Surat, India Netizens Technologies Full timeProven Experience as a Data Scientist (Preferably 2+ years), with a strong track - Record of delivering Impactful Data-driven solutions. - Strong Problem Solving, Quantitative, and Analytical skills - Solid knowledge of Data Science and Machine Learning fundamentals, with proven - Experience formulating Data Science solutions to business problems - Proven...
-
Data Engineer
3 weeks ago
Surat, Gujarat, India Technocruitx Universal Services Pvt. Ltd. Full timeRole Overview:At Technocruitx Universal Services Pvt. Ltd., we are seeking a skilled Data Engineer / Python Developer to join our team. As a key member, you will be responsible for designing and implementing web crawling tools to extract relevant data from websites. Your expertise in Python and JavaScript will be crucial in developing scalable and efficient...
-
Senior Data Engineer
3 weeks ago
Surat, Gujarat, India Technocruitx Universal Services Pvt. Ltd. Full timeWe are looking for a highly skilled Python Developer to join our team at Technocruitx Universal Services Pvt. Ltd.The ideal candidate will be passionate about Data Engineering and have a solid understanding of Python and JavaScript. They will also be confident in running large-scale web scrapes and familiar with the Chrome DevTools. Additionally, they should...