AI Tester with Automation Testing
Company: Cognizant Technology Solutions
Location: Weehawken
Posted on: March 31, 2026
|
|
|
Job Description:
About the role As an AI Tester with Automation expertise, you
will make an impact by validating the quality, performance, and
reliability of next generation AI and LLM powered applications. You
will be a valued member of the Quality Engineering and Assurance
team and work collaboratively with AI engineers, automation
architects, and cross functional stakeholders to ensure robust,
scalable, and compliant AI solutions.
________________________________________ In this role, you will: •
Design and execute automated test scripts using Python and
Playwright for AI, LLM, and ML workloads. • Validate LLM based
applications, including prompt flows, RAG pipelines, vector search,
and retrieval logic. • Test multi agent orchestration workflows,
including MCP/A2A protocol–based interactions. • Conduct
functional, integration, API, and data validation testing across
complex ML pipelines. • Collaborate with engineering teams to
troubleshoot defects, optimize model behavior, and ensure
compliance and accuracy of AI outputs.
________________________________________ Work model At Cognizant,
we strive to provide flexibility wherever possible, and we are here
to support a healthy work life balance through our various
wellbeing programs. Based on this role’s business requirements,
this is an onsite position requiring presence in Weehawken, New
Jersey. The working arrangements for this role are accurate as of
the date of posting and may change based on project engagement,
business needs, or client requirements.
________________________________________ What you need to have to
be considered 5 to 7 yrs. of QA experience with • Strong
programming proficiency in Python and hands on automation
experience with Playwright. • Working knowledge of AI/ML
algorithms, including NLP, classification, clustering, and LLM
evaluation. • Experience with LLM development frameworks such as
LangChain, LangGraph, vector databases, RAG architectures, and
prompt engineering. • Familiarity with multi agent AI
architectures, including multi agent orchestration using MCP and
A2A protocols. • Strong analytical skills with a solid
understanding of data modeling and data transformation using SQL. •
Experience testing or consuming APIs, RESTful services, and data
connectors. • Awareness of source code control systems such as
GitLab, along with CI/CD build and deployment pipelines.
________________________________________ These will help you stand
out • Hands on experience with Generative AI, GPT models, or
enterprise LLM deployments. • Exposure to cloud
platforms—especially Microsoft Azure—for AI, ML, or infrastructure
workloads. • Good understanding of Neo4j, knowledge graphs, or
graph based reasoning for LLM workflows. • Experience testing end
to end AI pipelines, including data ingestion, evaluation, and
observability. • Ability to work in fast paced, innovative
environments delivering scalable AI solutions • Cognizant will only
consider applicants for this position who are legally authorized to
work in the United States without company sponsorship. *Please
note, this role is not able to offer visa transfer or sponsorship
now or in the future* Were excited to meet people who share our
mission and can make an impact in a variety of ways. Dont hesitate
to apply, even if you only meet the minimum requirements listed.
Think about your transferable experiences and unique skills that
make you stand out as someone who can bring new and exciting things
to this role. Salary and Other Compensation: Applications will be
accepted until 4/17/2026. The annual salary for this position is
between [$53,477/- to $92,500/-] depending on experience and other
qualifications of the successful candidate. This position is also
eligible for Cognizant’s discretionary annual incentive program,
based on performance and subject to the terms of Cognizant’s
applicable plans. Benefits: Cognizant offers the following benefits
for this position, subject to applicable eligibility requirements:
• Medical/Dental/Vision/Life Insurance • Paid holidays plus Paid
Time Off • 401(k) plan and contributions • Long-term/Short-term
Disability • Paid Parental Leave • Employee Stock Purchase Plan The
Cognizant community: We are a high caliber team who appreciate and
support one another. Our people uphold an energetic, collaborative
and inclusive workplace where everyone can thrive. Cognizant is a
global community with more than 300,000 associates around the
world. We don’t just dream of a better way – we make it happen. We
take care of our people, clients, company, communities and climate
by doing what’s right. We foster an innovative environment where
you can build the career path that’s right for you. About us:
Cognizant is one of the worlds leading professional services
companies, transforming clients business, operating, and technology
models for the digital era. Our unique industry-based, consultative
approach helps clients envision, build, and run more innovative and
efficient businesses. Headquartered in the U.S., Cognizant (a
member of the NASDAQ-100 and one of Forbes World’s Best Employers
2025) is consistently listed among the most admired companies in
the world. Cognizant is an equal opportunity employer. Your
application and candidacy will not be considered based on race,
color, sex, religion, creed, sexual orientation, gender identity,
national origin, disability, genetic information, pregnancy,
veteran status or any other characteristic protected by federal,
state or local laws. Disclaimer: Compensation information is
accurate as of the date of this posting. Cognizant reserves the
right to modify this information at any time, subject to applicable
law. Applicants may be required to attend interviews in person or
by video conference. In addition, candidates may be required to
present their current state or government issued ID during each
interview.
Keywords: Cognizant Technology Solutions, New Haven , AI Tester with Automation Testing, IT / Software / Systems , Weehawken, Connecticut
