Attention prospective job seekers! Beware of fraudulent offers Read more

× Success! Job has been saved successfully.

Kafka Admin-Tech Lead

Chennai, Tamil Nadu, India
Posted on: 12-08-2024
Job description
Big Data Confluent KAFKA Administrator Tech Lead
Creation of key performance metrics, measuring the utilization, performance, and overall health of the cluste Perform highlevel, daytoday administration and support functions
Capacity planning and implementation of new/upgraded hardware and software releases as well as for storage infrastructure.
Research and recommend innovative ways to maintain the environment and where possible, automate key administration tasks.
Ability to work with various infrastructure, administration, and development teams across business units
Document and share design, build, upgrade and standard operating procedures. Conduct knowledge transfer sessions and workshops for other members in the team. Provide technical expertise and guidance to new and junior members in the team
Implemented and supported any enterprise product such as any well known ERP products, Data warehouse, Middleware etc.
Minimum 6 years of experience in BigData administration using KAKFA and related tools like Spark etc.
Minimum 4 years of experience in setting up the environment for solutions that collects and process data using Kafka Spark, Scala
Expert on Kafka Big Data solutions along with sound understanding of Kafka architecture
Manage single and multi-node Kafka cluster deployed on VM, Docker and Kubernetes Container platform. Experience with Confluent Platform running on prem
Perform Kafka Cluster build, MRC, including Design, Infrastructure planning, High Availability and Disaster Recovery
Implementing wire encryption using SSL, authentication using SASL LDAP authorization using Kafka ACLs in Zookeeper, Broker Client, Connect cluster connectors, Schema Registry, REST API, Producers Consumers, KsqlDevelop and maintain Unix scripts to perform day to day Kafka Admin and Security related functions using Confluent REST Proxy server
Setting up monitoring tools such as Prometheus, Grafana to scrape metrics from various Kafka cluster components Broker, Zookeeper, Connect, REST proxy, Mirror Maker, Schema Registry and other endpoints such as webservers, databases, logs etc. and configure alerts for Kafka Cluster and supporting infrastructure to measure availability and performance SLAs
Experience with Confluent ksql to query and process Kafka streams
Knowledge of Kafka Producer and Consumer APIs, Kafka Stream Processing, Confluent Ksql
Security related config for above listed software or any other tools in SSL for wire encryption, integration with AD for authentication and RBAC for authorizations
Database administration skills in Oracle, MSSQL, SAP HANA, DB2, Aerospike, Postgres ..
Exposure to SaaS based observability platform like New Relic
Deployment of container images and pods using CI/CD pipelines using Jenkins or comparable tools.
Experience in building Kafka deployment pipelines using Terraform, Ansible, Cloud formation templates, shells etc.
Availability to work in shifts, extended hours and to provide on call support as required. There will be work over weekends at times depending on the project needs.
Worked in Public cloud environment such as Azure or AWS or GCP, preferably in Azure
Must have excellent communications and interpersonal skills Preferred but Optional skills
Experience in a Financial Services or large complex and or global environment preferred
Effective written and verbal communication skills
Effective analytic diagnostic skills
Good presentation skills
Qualification

Big Data Confluent KAFKA Administrator Tech Lead
Creation of key performance metrics, measuring the utilization, performance, and overall health of the cluste Perform highlevel, daytoday administration and support functions
Capacity planning and implementation of new/upgraded hardware and software releases as well as for storage infrastructure.
Research and recommend innovative ways to maintain the environment and where possible, automate key administration tasks.
Ability to work with various infrastructure, administration, and development teams across business units
Document and share design, build, upgrade and standard operating procedures. Conduct knowledge transfer sessions and workshops for other members in the team. Provide technical expertise and guidance to new and junior members in the team
Implemented and supported any enterprise product such as any well known ERP products, Data warehouse, Middleware etc.
Minimum 6 years of experience in BigData administration using KAKFA and related tools like Spark etc.
Minimum 4 years of experience in setting up the environment for solutions that collects and process data using Kafka Spark, Scala
Expert on Kafka Big Data solutions along with sound understanding of Kafka architecture
Manage single and multi-node Kafka cluster deployed on VM, Docker and Kubernetes Container platform. Experience with Confluent Platform running on prem
Perform Kafka Cluster build, MRC, including Design, Infrastructure planning, High Availability and Disaster Recovery
Implementing wire encryption using SSL, authentication using SASL LDAP authorization using Kafka ACLs in Zookeeper, Broker Client, Connect cluster connectors, Schema Registry, REST API, Producers Consumers, KsqlDevelop and maintain Unix scripts to perform day to day Kafka Admin and Security related functions using Confluent REST Proxy server
Setting up monitoring tools such as Prometheus, Grafana to scrape metrics from various Kafka cluster components Broker, Zookeeper, Connect, REST proxy, Mirror Maker, Schema Registry and other endpoints such as webservers, databases, logs etc. and configure alerts for Kafka Cluster and supporting infrastructure to measure availability and performance SLAs
Experience with Confluent ksql to query and process Kafka streams
Knowledge of Kafka Producer and Consumer APIs, Kafka Stream Processing, Confluent Ksql
Security related config for above listed software or any other tools in SSL for wire encryption, integration with AD for authentication and RBAC for authorizations
Database administration skills in Oracle, MSSQL, SAP HANA, DB2, Aerospike, Postgres ..
Exposure to SaaS based observability platform like New Relic
Deployment of container images and pods using CI/CD pipelines using Jenkins or comparable tools.
Experience in building Kafka deployment pipelines using Terraform, Ansible, Cloud formation templates, shells etc.
Availability to work in shifts, extended hours and to provide on call support as required. There will be work over weekends at times depending on the project needs.
Worked in Public cloud environment such as Azure or AWS or GCP, preferably in Azure
Must have excellent communications and interpersonal skills Preferred but Optional skills
Experience in a Financial Services or large complex and or global environment preferred
Effective written and verbal communication skills
Effective analytic diagnostic skills
Good presentation skills

 Key job details

Primary Location
Chennai, Tamil Nadu, India
Job Type
Experienced
Primary Skills
Database, REST, API Verification
Years of Experience
8
Travel
No
Job Posting
12/08/2024

Join Virtusa

 

Please enter a valid email address to begin your application.

Thank you for verifying your email. Please proceed with the steps below to apply.

We only accept the following file extensions: .pdf, .docx or .doc
Maximum file size: 1 MB
File name must not include special characters or spaces (e.g. “name_resume.pdf”)

Please attach your CV/Resume, ensure it is in the correct format and smaller than 1MB.
We only accept the following file extensions:

Thank you. You already have an active account with Virtusa's hiring system. Please login to our portal to proceed with your application or apply for more opportunities.

LoginClick to Login

About Virtusa

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 36,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa is an Equal Opportunity Employer. All applicants will receive fair and impartial treatment without regard to race, color, religion, sex, national origin, ancestry, age, legally protected physical or mental disability, protected veteran status, status in the U.S. uniformed services, sexual orientation, gender identity or expression, marital status, genetic information or on any other basis which is protected under applicable federal, state or local law.

Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government-issued ID during each interview. All candidates must be authorized to work in the USA.

Learn more

Awards and recognition

Find us on Glassdoor.

Have any questions?

What is the best way to find and apply for positions at Virtusa?

To join our bright team of professionals, you can apply directly to our website under the Careers tab and search all open jobs. https://www.virtusa.com/careers

Can I apply for more than one position at the same time?

Yes, you can. Virtusa gives you the flexibility to apply for multiple open positions that excite you about your future and align to your experience and career goals.

Can I apply for a position across multiple geographical locations?

Yes, you can. Virtusa is a global Company, and we serve our clients through our global delivery model.

What happens after I’ve submitted my resume?

Our dedicated recruitment team will review your online application and match it to all our open jobs. We update our open jobs on a daily basis and encourage you to check back often.

How will I be evaluated for a career opportunity with Virtusa?

Our team of recruiters will review your application, relevant job experience, and skills to appropriately align it to our open jobs. From there, the recruitment team will contact the qualified candidate to start the interview process.

Career insights

Want to explore the ways you can engineer your career in technology? Our thought leaders share key career insights for candidates from entry-level job seekers to senior technologists.