Computer Science Student Justin Veltri Makes an Impact on AI Innovation at IBM

Monmouth University senior computer science student Justin Veltri detailed his summer work as a backend development intern with IBM in a recently published Medium article, where he discusses adapting Ollama software to run Large Language Models (LLMs) directly on IBM mainframe computers.

In "Ollama on IBM Z & LinuxONE (s390x): Enabling Local LLM Inference on the Mainframe," Veltri explores how running Artificial Intelligence (AI) models directly on IBM's Z and LinuxONE systems can allow the organization to use AI while keeping sensitive information within their own computer systems.

"My summer project at IBM involved adapting advanced artificial intelligence software to run on their massive mainframe computers. Taking Computer Architecture at Monmouth was absolutely crucial for this, I applied everything I learned in that class to my work at IBM, and without that strong foundation, I never would have gotten as far as I did," Veltri said.

During his internship, Veltri worked with a team to adapt Ollama, a software tool that allows LLMs to run directly on a computer instead of relying on external services, for IBM's mainframe systems. The technology allows AI models to analyze information and generate responses without requiring sensitive data to be sent to an outside system. This can give organizations greater control over their information while supporting security and privacy requirements.

Following this summer project, Veltri received a full-time software engineering return offer at IBM and plans to begin employment following graduation this January.

"Monmouth University and its connections are the only reason I've had the opportunity to work at IBM. I encourage everyone attending to use their time at Monmouth to build connections with staff and fellow students. There are opportunities everywhere, but you need to take the initiative," he said.

Monmouth's Bachelor of Science in Computer Science program provides students with a foundation in programming, software development, data management, computer systems and emerging technologies. The program is accredited by the Computing Accreditation Commission of ABET, a globally recognized standard for programs in computing and engineering.