Cover Image

Multi-Modal Instruction-Tuning Small-Scale Language-and-Vision Assistant for Semiconductor Electron Micrograph Analysis

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Srinivas, Sakhinana Sagar, Sannidhi, Geethan, Runkana, Venkataramana
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Foundational Model for Electron Micrograph Analysis: Instruction-Tuning Small-Scale Language-and-Vision Assistant for Enterprise Adoption
by: Srinivas, Sakhinana Sagar, et al.
Published: (2024)

Parameter-Efficient Quantized Mixture-of-Experts Meets Vision-Language Instruction Tuning for Semiconductor Electron Micrograph Analysis
by: Srinivas, Sakhinana Sagar, et al.
Published: (2024)

Hierarchical Network Fusion for Multi-Modal Electron Micrograph Representation Learning with Foundational Large Language Models
by: Srinivas, Sakhinana Sagar, et al.
Published: (2024)

Preliminary Investigations of a Multi-Faceted Robust and Synergistic Approach in Semiconductor Electron Micrograph Analysis: Integrating Vision Transformers with Large Language and Multimodal Models
by: Srinivas, Sakhinana Sagar, et al.
Published: (2024)

Sparks of Artificial General Intelligence(AGI) in Semiconductor Material Science: Early Explorations into the Next Frontier of Generative AI-Assisted Electron Micrograph Analysis
by: Srinivas, Sakhinana Sagar, et al.
Published: (2024)

Towards Human-Level Understanding of Complex Process Engineering Schematics: A Pedagogical, Introspective Multi-Agent Framework for Open-Domain Question Answering
by: Sakhinana, Sagar Srinivas, et al.
Published: (2024)

EMCNet : Graph-Nets for Electron Micrographs Classification
by: Srinivas, Sakhinana Sagar, et al.
Published: (2024)

Retrieval-Augmented Instruction Tuning for Automated Process Engineering Calculations : A Tool-Chaining Problem-Solving Framework with Attributable Reflection
by: Sakhinana, Sagar Srinivas, et al.
Published: (2024)

Advancing Enterprise Spatio-Temporal Forecasting Applications: Data Mining Meets Instruction Tuning of Language Models For Multi-modal Time Series Analysis in Low-Resource Settings
by: Sakhinana, Sagar Srinivas, et al.
Published: (2024)

Retrieval-Augmented Generation Meets Data-Driven Tabula Rasa Approach for Temporal Knowledge Graph Forecasting
by: Sannidhi, Geethan, et al.
Published: (2024)

Reprogramming Foundational Large Language Models(LLMs) for Enterprise Adoption for Spatio-Temporal Forecasting Applications: Unveiling a New Era in Copilot-Guided Cross-Modal Time Series Representation Learning
by: Srinivas, Sakhinana Sagar, et al.
Published: (2024)

Cross-Modal Learning for Chemistry Property Prediction: Large Language Models Meet Graph Machine Learning
by: Srinivas, Sakhinana Sagar, et al.
Published: (2024)

Vision HgNN: An Electron-Micrograph is Worth Hypergraph of Hypernodes
by: Srinivas, Sakhinana Sagar, et al.
Published: (2024)

Crossing New Frontiers: Knowledge-Augmented Large Language Model Prompting for Zero-Shot Text-Based De Novo Molecule Design
by: Srinivas, Sakhinana Sagar, et al.
Published: (2024)

AutoChemSchematic AI: Agentic Physics-Aware Automation for Chemical Manufacturing Scale-Up
by: Srinivas, Sakhinana Sagar, et al.
Published: (2025)

Agentic Retrieval-Augmented Generation for Time Series Analysis
by: Ravuru, Chidaksh, et al.
Published: (2024)

Towards Automated Patent Workflows: AI-Orchestrated Multi-Agent Framework for Intellectual Property Management and Analysis
by: Srinivas, Sakhinana Sagar, et al.
Published: (2024)

Knowledge Graph Modeling-Driven Large Language Model Operating System (LLM OS) for Task Automation in Process Engineering Problem-Solving
by: Srinivas, Sakhinana Sagar, et al.
Published: (2024)

Hypergraph Learning based Recommender System for Anomaly Detection, Control and Optimization
by: Srinivas, Sakhinana Sagar, et al.
Published: (2024)

Battery GraphNets : Relational Learning for Lithium-ion Batteries(LiBs) Life Estimation
by: Srinivas, Sakhinana Sagar, et al.
Published: (2024)

Scaling Test-Time Inference with Policy-Optimized, Dynamic Retrieval-Augmented Generation via KV Caching and Decoding
by: Srinivas, Sakhinana Sagar, et al.
Published: (2025)

Accelerating Manufacturing Scale-Up from Material Discovery Using Agentic Web Navigation and Retrieval-Augmented AI for Process Engineering Schematics Design
by: Srinivas, Sakhinana Sagar, et al.
Published: (2024)

Multi-Knowledge Fusion Network for Time Series Representation Learning
by: Sakhinana, Sagar Srinivas, et al.
Published: (2024)

Multi-Source Knowledge-Based Hybrid Neural Framework for Time Series Representation Learning
by: Sakhinana, Sagar Srinivas, et al.
Published: (2024)

Agentic Multimodal AI for Hyperpersonalized B2B and B2C Advertising in Competitive Markets: An AI-Driven Competitive Advertising Framework
by: Srinivas, Sakhinana Sagar, et al.
Published: (2025)

Joint Hypergraph Rewiring and Memory-Augmented Forecasting Techniques in Digital Twin Technology
by: Sakhinana, Sagar Srinivas, et al.
Published: (2024)

Bayesian Multi-Scale Neural Network for Crowd Counting
by: Sagar, Abhinav
Published: (2020)

pFedMMA: Personalized Federated Fine-Tuning with Multi-Modal Adapter for Vision-Language Models
by: Ghiasvand, Sajjad, et al.
Published: (2025)

Efficient Test-Time Scaling for Small Vision-Language Models
by: Kaya, Mehmet Onurcan, et al.
Published: (2025)

MMRL: Multi-Modal Representation Learning for Vision-Language Models
by: Guo, Yuncheng, et al.
Published: (2025)

Yo'LLaVA: Your Personalized Language and Vision Assistant
by: Nguyen, Thao, et al.
Published: (2024)

Multi-Modal Adapter for Vision-Language Models
by: Seputis, Dominykas, et al.
Published: (2024)

PointSAGE: Mesh-independent superresolution approach to fluid flow predictions
by: Sarkar, Rajat, et al.
Published: (2024)

TextSquare: Scaling up Text-Centric Visual Instruction Tuning
by: Tang, Jingqun, et al.
Published: (2024)

Explainable Concept Generation through Vision-Language Preference Learning for Understanding Neural Networks' Internal Representations
by: Taparia, Aditya, et al.
Published: (2024)

Instruction-Guided Fusion of Multi-Layer Visual Features in Large Vision-Language Models
by: Li, Xu, et al.
Published: (2024)

MMLoP: Multi-Modal Low-Rank Prompting for Efficient Vision-Language Adaptation
by: Ghiasvand, Sajjad, et al.
Published: (2026)

LLARVA: Vision-Action Instruction Tuning Enhances Robot Learning
by: Niu, Dantong, et al.
Published: (2024)

ProJudge: A Multi-Modal Multi-Discipline Benchmark and Instruction-Tuning Dataset for MLLM-based Process Judges
by: Ai, Jiaxin, et al.
Published: (2025)

Dynamic Cross-Modal Prompt Generation for Multimodal Continual Instruction Tuning
by: Hu, Tao, et al.
Published: (2026)