Big Data Tester
2 weeks ago
**JOB DESCRIPTION FOR BIG DATA ENGINEER**
**Job Role ** : Big Data Testing
**Job Type** : FTE
**Location** : Hybrid
**Notice Period** : Immediate to 30 days
**Experience ** : 3+ YRS
**Desired Skills and Experience.**
- Demonstrated testing & automation experience of 3-6 Years in Big data technology stack - Hadoop, HDFS & Spark
- Good understanding of Hive concepts and knowledge of NoSQL DB preferable
- Proficient in writing complex SQL, Hive QL and Spark QL queries
- Ability to test software & get UAT done from business users in Agile manner
- Continuous automation to increase test coverage and efficiency
- Proactive & reactive support in deployments & production environment
- Expert in one of the scripting languages such as Python/Shell/Perl.
- Hands on experience in Linux or Unix
- Good debugging skills
- Proficient understanding of distributed computing principles
- Management of Hadoop cluster and spark, with all included services
- Ability to solve any ongoing issues with operating the cluster
- Proficiency with Hadoop v2, MapReduce, HDFS
- Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming
- Experience with integration of data from multiple data sources
- Experience with NoSQL databases, such as HBase, MongoDB
- Added advantage with BI tools like PowerBI and Tableau
- Knowledge of various ETL techniques and frameworks, such as Flume
- Experience with various messaging systems, such as Kafka or RabbitMQ
- Experience with Big Data ML toolkits, such as Mahout, SparkML
- Good understanding of Lambda Architecture, along with its advantages and drawback
**Job Types**: Full-time, Regular / Permanent
**Salary**: ₹291,203.91 - ₹1,000,000.00 per year
Schedule:
- Day shift
- Morning shift
Ability to commute/relocate:
- Chennai, Chennai - 600096, Tamil Nadu: Reliably commute or planning to relocate before starting work (required)
**Education**:
- Bachelor's (preferred)
**Experience**:
- Big data: 4 years (required)
- SQL: 1 year (required)
- Hadoop: 1 year (required)
- HDFS: 1 year (required)
- Cloud: 1 year (required)
**Speak with the employer**
+91 7200098547
-
Big Data Architect
3 weeks ago
Chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilitiesDesign and architect Big Data solutions to meet business requirements.Collaborate with stakeholders to understand their data and analytics needs.Create and maintain data models, data flow diagrams, and data integration strategies.Develop and implement data ingestion, processing, and storage solutions using Big Data technologies.Optimize data...
-
Big Data Architect
4 weeks ago
Chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. Optimize...
-
Big Data Architect
4 weeks ago
chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. ...
-
Architect - Big Data
6 days ago
Chennai, India Databricks Full timeCSQ125R88As anArchitect (Big Data)in our Professional Services team you will work with clients on short to medium term customer engagements on theirBig Data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...
-
Architect - Big Data
1 week ago
chennai, India Databricks Full timeCSQ125R88 As an Architect (Big Data) in our Professional Services team you will work with clients on short to medium term customer engagements on their Big Data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...
-
Architect - Big Data
1 week ago
Chennai, India Databricks Full timeCSQ125R88As an Architect (Big Data) in our Professional Services team you will work with clients on short to medium term customer engagements on their Big Data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...
-
Big Data Architect
1 week ago
Chennai, India Databricks Full timeCSQ225R24As aResident Solutions Architectin our Professional Services team you will work with clients on short to medium term customer engagements on theirbig data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...
-
Big Data Architect
1 week ago
chennai, India Databricks Full timeCSQ225R24 As a Resident Solutions Architect in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform . You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...
-
Big Data Architect
1 week ago
Chennai, India Databricks Full timeCSQ225R24As a Resident Solutions Architect in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other...
-
Big Data Architect
1 month ago
Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time**Responsibilities**: - Design and architect Big Data solutions to meet business requirements. - Collaborate with stakeholders to understand their data and analytics needs. - Create and maintain data models, data flow diagrams, and data integration strategies. - Develop and implement data ingestion, processing, and storage solutions using Big Data...
-
Big Data Developer
3 weeks ago
Chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilitiesDesign, develop, and deploy scalable Big Data applications using Apache Spark.Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions.Write efficient and optimized code to process and analyze large volumes of data.Implement data ingestion processes from various data sources...
-
Big Data Developer
1 month ago
chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable Big Data applications using Apache Spark. Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...
-
Big Data Developer
1 month ago
Chennai, India RiskInsight Consulting Pvt Ltd Full timeResponsibilities Design, develop, and deploy scalable Big Data applications using Apache Spark. Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions. Write efficient and optimized code to process and analyze large volumes of data. Implement data ingestion processes from various data...
-
DW and Big Data analyst
1 month ago
chennai, India Anicalls (Pty) Ltd Full time• Cloud Data Analytics (AWS, Oracle, Azure, Snowflake) – Hands-on solution design experience in at least two of cloud platforms.• Experience in growing & mining existing accounts• Experience in implementing at least 4 Cloud Data Analytics & Big Data engagements.• Extensive experience in solution design in complex projects in big data, cloud...
-
Big Data Developer
3 weeks ago
Chennai, India Citi Full timeThe Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...
-
Big Data Developer
3 weeks ago
chennai, India Citi Full timeThe Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...
-
Big Data Developer
2 weeks ago
Chennai, India Citi Full timeThe Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...
-
Data Engineer
2 weeks ago
Chennai, India Mobile Programming LLC Full timeJob Role : Mobile Programming is looking for an experienced data engineer who will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. You should have strong analytical skills...
-
Data Engineer
1 month ago
chennai, India Mobile Programming LLC Full timeJob Role : Mobile Programming is looking for an experienced data engineer who will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. You should have strong analytical skills and the...
-
Data Engineer
2 weeks ago
Chennai, India Mobile Programming LLC Full timeJob Role :Mobile Programming is looking for an experienced data engineer who will use various methods to transform raw data into useful data systems. For example, you'll create algorithms and conduct statistical analysis. Overall, you'll strive for efficiency by aligning data systems with business goals. You should have strong analytical skills and...