Innova Hiring Data Engineer For Hyderabad Location

From 6 to 10 year(s) of experience
₹ Not Disclosed by Recruiter

Job Description

Roles and Responsibilities


Data Engineer Experience:

Exp :6+ years

Location: Hyderabad

Duties And Responsibilities • Data Engineer is part of the product engineering team designing and developing, integrating the data-centric sub-systems of the platform in a cloud-based SaaS environment. • Data engineer will be part of product development scrum teams in implementing data platform features, enhancements, optimizing, consolidating, and modernizing the existing implementations. • Date engineer will be following the DevOps processes in design, development, automation for infrastructure as code, continuous integration, and delivery, and provide post rollout Tier-3/4 operation support to the SRE teams. Requirements • Design and implementation experience in building cloud-based data platforms following the architecture patterns to real-time data streams, database-driven application development to support secure, performant, scalable, resilient, real-time/near real-time processing, distributed architecture principles leveraging cloud-managed data lakes, SQL, NoSQL databases, streaming buses, and serverless implementations. • Knowledge of upstream data ingestion, data automation, digitization as needed, data curation, data extraction, quality • Knowledge of data processing/pipelines, classification, automated/rules-based data mapping, matching, merging, data masking, master data management • Knowledge of Data platform architecture to support BI/Analytics data virtualization, virtual data marts, self-service, search • Knowledge of Data platform architecture for secure data access self-service, though Graph QL-based APIs • Knowledge of technology stacks: Apache Kafka, AWS Kinesis, PySpark, Databricks, AWS EMR, Hudi, AWS Batch, C#, .Net, .Net Core • Architecture experience in leveraging data sciences/machine learning in the security event processing data discovery, knowledge models, behavioral analysis, detection of patterns, correlation of events for anomaly/threat detection, decision making, and prioritization • Architecture experience in supporting ML Ops pipelines for centralized training of models, versioning, approval process, and on-demand deployment of models • Database architecture experience using relational databases such as Oracle, SQL, Postgres, MySQL, NoSQL databases such as MongoDB, Cassandra, DynamoDB, Cosmos, Bigdata • Architecture of BI and analytics: Operational, executive dashboards, reports, trends, predictive analytics • Working knowledge of Data platform architecture in support of data operations and management to support personas for operational, reporting, analytics, on-demand, and streaming • Knowledge of data security and governance: glossary, rules, policies, workflows, quality • Experience in containerization, Kubernetes-based container orchestration, service mesh, implementations using cloud-based PaaS services ECR, EKS, Istio • Must have Data architecture experience towards a SaaS development platform • Experience in Conceptualize and designing Architectural elements for different scenarios • Experience in software development, cloud infrastructure, and application deployment • Understanding of implementation in enterprise applications, solutions, and data center infrastructures. • Familiar with mainstream IaaS provider services from AWS or Azure • Knowledge of working with large datasets using Elastic Search, Snowflake, or similar technology • Familiar with the use of stream processing technologies like Apache Flink • Ability to tackle problems involving large, complex systems. • Ability to collaborate effectively across disciplines, roles, and geographical and time zone boundaries • Proficiency in cross-location communication and the English language • Excellent Communication skills The candidate should be able to communicate well with Onsite clients/ Product Owners • Critical Thinking and Listening Capabilities and demonstrate the same with the Client • Experience in supporting large-scale, production deployments on mainstream cloud platforms


Key Skills
Skills highlighted with ‘‘ are preferred keyskills

Education

UG:B.Tech/B.E. in Any Specialization

Company Profile

Innova Solutions

Aishwarya Singh

Lead Talent Acquisition - Human Resource

Innova Solutions Private Limited

aishwarya.singh@innovasolutions.com

https://www.innovasolutions.com

Company Info
X
View Contact Details+

Contact Company:Innova Solutions

Address:284/1A,4th FlOOR,,OLD MAHABALIPURAM ROAD,KANDANCHA, VIDI, PERUNGUDI PO, Chennai, Tamilnadu, India

Salary:

Not Disclosed by Recruiter

Functional Area:

Data Science & Analytics

Role Category:

Data Science & Machine Learning

Role:

Data Engineer

Employment Type:

Full Time, Permanent