publications

2024

1. WACV

   DECDM: Document Enhancement using Cycle-Consistent Diffusion Models

   Jiaxin Zhang, Joy Rimchala, Lalla Mouatadid, Kamalika Das, and Sricharan Kumar

   In IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2024

   Abs

   The performance of optical character recognition (OCR) heavily relies on document image quality, which is crucial for automatic document processing and document intelligence. However, most existing document enhancement methods require supervised data pairs, which raises concerns about data separation and privacy protection, and makes it challenging to adapt these methods to new domain pairs. To address these issues, we propose DECDM, an end-to-end document-level image translation method inspired by recent advances in diffusion models. Our method overcomes the limitations of paired training by independently training the source (noisy input) and target (clean output) models, making it possible to apply domain-specific diffusion models to other pairs. DECDM trains on one dataset at a time, eliminating the need to scan both datasets concurrently, and effectively preserving data privacy from the source or target domain. We also introduce simple data augmentation strategies to improve character-glyph conservation during translation. We compare DECDM with state-of-the-art methods on multiple synthetic data and benchmark datasets, such as document denoising and shadow removal, and demonstrate the superiority of performance quantitatively and qualitatively.

2. WACV

   On the Quantification of Image Reconstruction Uncertainty without Training Data

   Jiaxin Zhang, Sirui Bi, and Victor Fung

   In IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2024

   Abs

   Computational imaging plays a pivotal role in determining hidden information from sparse measurements. A robust inverse solver is crucial to fully characterize the uncertainty induced by these measurements, as it allows for the estimation of the complete posterior of unrecoverable targets. This, in turn, facilitates a probabilistic interpretation of observational data for decision-making. In this study, we propose a deep variational framework that leverages a deep generative model to learn an approximate posterior distribution to effectively quantify image reconstruction uncertainty without the need for training data. We parameterize the target posterior using a flow-based model and minimize their Kullback-Leibler (KL) divergence to achieve accurate uncertainty estimation. To bolster stability, we introduce a robust flow-based model with bi-directional regularization and enhance expressivity through gradient boosting. Additionally, we incorporate a space-filling design to achieve substantial variance reduction on both latent prior space and target posterior space. We validate our method on several benchmark tasks and two real-world applications, namely fastMRI and black hole image reconstruction. Our results indicate that our method provides reliable and high-quality image reconstruction with robust uncertainty estimation.

2023

1. NeurIPS

   Interactive Multi-fidelity Learning for Cost-effective Adaptation of Language Model with Sparse Human Supervision

   Jiaxin Zhang, Zhuohang Li, Kamalika Das, and Sricharan Kumar

   In Advances in Neural Information Processing Systems, 2023

   Abs arXiv PDF Poster Slides

   Large language models (LLMs) have demonstrated remarkable capabilities in various tasks. However, their suitability for domain-specific tasks, is limited due to their immense scale at deployment, susceptibility to misinformation, and more importantly, high data annotation costs. We propose a novel Interactive Multi-Fidelity Learning (IMFL) framework for the cost-effective development of small domain-specific LMs under limited annotation budgets. Our approach formulates the domain-specific fine-tuning process as a multi-fidelity learning problem, focusing on identifying the optimal acquisition strategy that balances between low-fidelity automatic LLM annotations and high-fidelity human annotations to maximize model performance. We further propose an exploration-exploitation query strategy that enhances annotation diversity and informativeness, incorporating two innovative designs: 1) prompt retrieval that selects in-context examples from human-annotated samples to improve LLM annotation, and 2) variable batch size that controls the order for choosing each fidelity to facilitate knowledge distillation, ultimately enhancing annotation quality. Extensive experiments on financial and medical tasks demonstrate that IMFL achieves superior performance compared with single fidelity annotations. Given a limited budget of human annotation, IMFL significantly outperforms the human annotation baselines in all four tasks and achieves very close performance as human annotations on two of the tasks. These promising results suggest that the high human annotation costs in domain-specific tasks can be significantly reduced by employing IMFL, which utilizes fewer human annotations, supplemented with cheaper and faster LLM (e.g., GPT-3.5) annotations to achieve comparable performance.

2. EMNLP

   SAC^3: Reliable Hallucination Detection in Black-Box Language Models via Semantic-aware Cross-check Consistency

   Jiaxin Zhang, Zhuohang Li, Kamalika Das, Bradley Malin, and Sricharan Kumar

   In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, 2023

   Abs arXiv PDF Code

   Hallucination detection is a critical step toward understanding the trustworthiness of modern language models (LMs). To achieve this goal, we re-examine existing detection approaches based on the self-consistency of LMs and uncover two types of hallucinations resulting from 1) question-level and 2) model-level, which cannot be effectively identified through self-consistency check alone. Building upon this discovery, we propose a novel sampling-based method, i.e., semantic-aware cross-check consistency (SAC3) that expands on the principle of self-consistency checking. Our SAC3 approach incorporates additional mechanisms to detect both question-level and model-level hallucinations by leveraging advances including semantically equivalent question perturbation and cross-model response consistency checking. Through extensive and systematic empirical analysis, we demonstrate that SAC3 outperforms the state of the art in detecting both non-factual and factual statements across multiple question-answering and open-domain generation benchmarks.

3. ICLR Workshop

   On the Robustness of Diffusion Inversion in Image Manipulation

   Jiaxin Zhang, Kamalika Das, and Sricharan Kumar

   In ICLR 2023 Workshop on Trustworthy and Reliable Large-Scale Machine Learning Models, 2023

   Abs PDF

   Text-guided image editing is a rapidly growing field due to the development of large diffusion models. In this work, we present an effective approach to address the key step of real image editing, known as “inversion", which involves finding the initial noise vector that reconstructs the input image when conditioned on a text prompt. Existing works on conditional inversion is often unstable and inaccurate, leading to distorted image manipulation. To address these challenges, our method starts by analyzing the inconsistent assumptions and accumulative errors that contribute to the ill-posedness of mathematical inverse problems. We then introduce learnable latent variables as bias correction to approximate invertible and bijective inversion. We perform latent trajectory optimization with a prior to fully invert the image by optimizing the bias correction on the unconditional text prompt and initial noise vector. Our method is based on the publicly Stable Diffusion model and is extensively evaluated on a variety of images and prompt editing, demonstrating high accuracy, robustness, and quality compared to state-of-the-art baseline approaches.

4. NeurIPS Workshop

   A Divide-Conquer-Reasoning Approach to Consistency Evaluation and Improvement in Blackbox Large Language Models

   Wendi Cui, Jiaxin Zhang, Zhuohang Li, Damien Lopez, Kamalika Das, Malin Bradley, and Sricharan Kumar

   In NeurIPS 2023 Workshop on Socially Responsible Language Modelling Research, 2023

   Abs PDF Poster

   Evaluating the quality and variability of text generated by Large Language Models (LLMs) poses a significant, yet unresolved research challenge. Traditional evaluation methods, such as ROUGE and BERTScore, which measure token similarity, often fail to capture the holistic semantic equivalence. This results in a low correlation with human judgments and intuition, which is especially problematic in high-stakes applications like healthcare and finance where reliability, safety, and robust decision-making are highly critical. This work proposes an automated framework for evaluating the consistency of LLM-generated texts using a divide-and-conquer strategy. Unlike existing LLM-based evaluators that operate at the paragraph level, our method employs a divide-and-conquer evaluator (DCE) that breaks down the comparison between two generated responses into individual sentences, each evaluated based on predefined criteria. To facilitate this approach, we introduce an automatic metric converter (AMC) that translates the output from DCE into an interpretable numeric score. Beyond the consistency evaluation, we further present a reason-assisted improver (RAI) that leverages the analytical reasons with explanations identified by DCE to generate new responses aimed at reducing these inconsistencies. Through comprehensive and systematic empirical analysis, we show that our approach outperforms state-of-the-art methods by a large margin (e.g., +19.3% and +24.3% on the SummEval dataset) in evaluating the consistency of LLM generation across multiple benchmarks in semantic, factual, and summarization consistency tasks. Our approach also substantially reduces nearly 90% output inconsistencies, showing promise for effective hallucination mitigation and reduction.

5. ICASSP

   Speech Privacy Leakage from Shared Gradients in Distributed Learning

   Zhuohang Li, Jiaxin Zhang, and Jian Liu

   In ICASSP 2023-2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2023

   Abs arXiv PDF

   Distributed machine learning paradigms, such as federated learning, have been recently adopted in many privacy-critical applications for speech analysis. However, such frameworks are vulnerable to privacy leakage attacks from shared gradients. Despite extensive efforts in the image domain, the exploration of speech privacy leakage from gradients is quite limited. In this paper, we explore methods for recovering private speech/speaker information from the shared gradients in distributed learning settings. We conduct experiments on a keyword spotting model with two different types of speech features to quantify the amount of leaked information by measuring the similarity between the original and recovered speech signals. We further demonstrate the feasibility of inferring various levels of side-channel information, including speech content and speaker identity, under the distributed learning framework without accessing the user’s data.

6. AAAI

   Accelerating Inverse Learning via Intelligent Localization with Exploratory Sampling

   Jiaxin Zhang, Sirui Bi, and Victor Fung

   Proceedings of the AAAI Conference on Artificial Intelligence, 2023

   Abs arXiv PDF Code

   In the scope of "AI for Science", solving inverse problems is a longstanding challenge in materials and drug discovery, where the goal is to determine the hidden structures given a set of desirable properties. Deep generative models are recently proposed to solve inverse problems, but these currently use expensive forward operators and struggle in precisely localizing the exact solutions and fully exploring the parameter spaces without missing solutions. In this work, we propose a novel approach (called iPage) to accelerate the inverse learning process by leveraging probabilistic inference from deep invertible models and deterministic optimization via fast gradient descent. Given a target property, the learned invertible model provides a posterior over the parameter space; we identify these posterior samples as an intelligent prior initialization which enables us to narrow down the search space. We then perform gradient descent to calibrate the inverse solutions within a local region. Meanwhile, a space-filling sampling is imposed on the latent space to better explore and capture all possible solutions. We evaluate our approach on three benchmark tasks and two created datasets with real-world applications from quantum chemistry and additive manufacturing, and find our method achieves superior performance compared to several state-of-the-art baseline methods.

7. AAAI

   AutoNF: Automated Architecture Optimization of Normalizing Flows Using a Mixture Distribution Formulation

   Yu Wang, Jan Drgona, Jiaxin Zhang, Karthik Somayaji NS, Frank Y Liu, Malachi Schram, and Peng Li

   Proceedings of the AAAI Conference on Artificial Intelligence, 2023

   Abs PDF

   Normalizing flows (NF) build upon invertible neural networks and have wide applications in probabilistic modeling. Currently, building a powerful yet computationally efficient flow model relies on empirical fine-tuning over a large design space. While introducing neural architecture search (NAS) to NF is desirable, the invertibility constraint of NF brings new challenges to existing NAS methods whose application is limited to unstructured neural networks. Developing efficient NAS methods specifically for NF remains an open problem. We present AutoNF, the first automated NF architectural optimization framework. First, we present a new mixture distribution formulation that allows efficient differentiable architecture search of flow models without violating the invertibility constraint. Second, under the new formulation, we convert the original NP-hard combinatorial NF architectural optimization problem to an unconstrained continuous relaxation admitting the discrete optimal architectural solution, circumventing the loss of optimality due to binarization in architectural optimization. We evaluate AutoNF with various density estimation datasets and show its superior performance-cost trade-offs over a set of existing hand-crafted baselines.

8. AI4Science

   Data driven modeling of interfacial traction–separation relations using a thermodynamically consistent neural network

   Congjie Wei, Jiaxin Zhang, Kenneth M Liechti, and Chenglin Wu

   Computer Methods in Applied Mechanics and Engineering, 2023

2022

1. AI4Science

   Atomic structure generation from reconstructing structural fingerprints

   Victor Fung, Shuyi Jia, Jiaxin Zhang, Sirui Bi, Junqi Yin, and P Ganesh

   Machine Learning: Science and Technology, 2022
2. IJCAI Workshop

   Self-supervised Novelty Detection for Continual Learning: A Gradient-Based Approach Boosted by Binary Classification

   Jingbo Sun, Li Yang, Jiaxin Zhang, Frank Liu, Mahantesh Halappanavar, Deliang Fan, and Yu Cao

   In Continual Semi-Supervised Learning: First International Workshop, CSSL 2021, Virtual Event, August 19–20, 2021, Revised Selected Papers, 2022
3. AI4Science

   Machine learning for high-entropy alloys: progress, challenges and opportunities

   Xianglin Liu, Jiaxin Zhang, and Zongrui Pei

   Progress in Materials Science, 2022
4. EMBC

   Fair and Privacy-Preserving Alzheimer’s Disease Diagnosis Based on Spontaneous Speech Analysis via Federated Learning

   Syed Irfan Ali Meerza, Zhuohang Li, Luyang Liu, Jiaxin Zhang, and Jian Liu

   In 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), 2022
5. EMBC

   Privacy-preserving Speech-based Depression Diagnosis via Federated Learning

   Yue Cui, Zhuohang Li, Luyang Liu, Jiaxin Zhang, and Jian Liu

   In 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC), 2022
6. CVPR

   Auditing Privacy Defenses in Federated Learning via Generative Gradient Leakage

   Zhuohang Li, Jiaxin Zhang, Luyang Liu, and Jian Liu

   In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022

   Abs arXiv PDF Code

   Federated Learning (FL) framework brings privacy benefits to distributed learning systems by allowing multiple clients to participate in a learning task under the coordination of a central server without exchanging their private data. However, recent studies have revealed that private information can still be leaked through shared gradient information. To further protect user’s privacy, several defense mechanisms have been proposed to prevent privacy leakage via gradient information degradation methods, such as using additive noise or gradient compression before sharing it with the server. In this work, we validate that the private training data can still be leaked under certain defense settings with a new type of leakage, ie, Generative Gradient Leakage (GGL). Unlike existing methods that only rely on gradient information to reconstruct data, our method leverages the latent space of generative adversarial networks (GAN) learned from public image datasets as a prior to compensate for the informational loss during gradient degradation. To address the nonlinearity caused by the gradient operator and the GAN model, we explore various gradient-free optimization methods (eg, evolution strategies and Bayesian optimization) and empirically show their superiority in reconstructing high-quality images from gradients compared to gradient-based optimizers. We hope the proposed method can serve as a tool for empirically measuring the amount of privacy leakage to facilitate the design of more robust defense mechanisms.

7. AI4Science

   Invertible neural networks for E3SM land model calibration and simulation

   Dan Lu, Daniel M Ricciuto, and Jiaxin Zhang

   In ICLR 2022 Workshop on AI for Earth and Space Science, 2022
8. AAAI

   Gradient-based Novelty Detection Boosted by Self-supervised Binary Classification

   Jingbo Sun, Li Yang, Jiaxin Zhang, Frank Liu, Mahantesh Halappanavar, Deliang Fan, and Yu Cao

   In Proceedings of the AAAI Conference on Artificial Intelligence, 2022

   Abs arXiv PDF

   Novelty detection aims to automatically identify out-of-distribution (OOD) data, without any prior knowledge of them. It is a critical step in data monitoring, behavior analysis and other applications, helping enable continual learning in the field. Conventional methods of OOD detection perform multi-variate analysis on an ensemble of data or features, and usually resort to the supervision with OOD data to improve the accuracy. In reality, such supervision is impractical as one cannot anticipate the anomalous data. In this paper, we propose a novel, self-supervised approach that does not rely on any pre-defined OOD data:(1) The new method evaluates the Mahalanobis distance of the gradients between the in-distribution and OOD data.(2) It is assisted by a self-supervised binary classifier to guide the label selection to generate the gradients, and maximize the Mahalanobis distance. In the evaluation with multiple datasets, such as CIFAR-10, CIFAR-100, SVHN and TinyImageNet, the proposed approach consistently outperforms state-of-the-art supervised and unsupervised methods in the area under the receiver operating characteristic (AUROC) and area under the precision-recall curve (AUPR) metrics. We further demonstrate that this detector is able to accurately learn one OOD class in continual learning.

9. AI4Science

   Deep-green inversion to extract traction-separation relations at material interfaces

   Congjie Wei, Jiaxin Zhang, Kenneth M Liechti, and Chenglin Wu

   International Journal of Solids and Structures, 2022
10. AI4Science

    Blackbox optimization for approximating high-fidelity heat transfer calculations in metal additive manufacturing

    Sirui Bi, Benjamin Stump, Jiaxin Zhang, Yousub Lee, John Coleman, Matt Bement, and Guannan Zhang

    Results in Materials, 2022

2021

1. ICPADS

   Byzantine-robust federated learning through spatial-temporal analysis of local model updates

   Zhuohang Li, Luyang Liu, Jiaxin Zhang, and Jian Liu

   In 2021 IEEE 27th International Conference on Parallel and Distributed Systems (ICPADS), 2021
2. AI4Science

   Inverse design of two-dimensional materials with invertible neural networks

   Victor Fung, Jiaxin Zhang, Guoxiang Hu, and Bobby G Sumpter

   npj Computational Materials, 2021
3. AI4Science

   Simulation intelligence: Towards a new generation of scientific methods

   Alexander Lavin, Hector Zenil, Brooks Paige, David Krakauer, Justin Gottschlich, Tim Mattson, Anima Anandkumar, Sanjay Choudry, Kamil Rocki, Atılım Güneş Baydin, and  others

   arXiv preprint arXiv:2112.03235, 2021
4. NeurIPS

   On the Stochastic Stability of Deep Markov Models

   Jan Drgona, Sayak Mukherjee, Jiaxin Zhang, Frank Liu, and Mahantesh Halappanavar

   Advances in Neural Information Processing Systems, 2021

   Abs arXiv PDF Code

   Deep Markov models (DMM) are generative models which are scalable and expressive generalization of Markov models for representation, learning, and inference problems. However, the fundamental stochastic stability guarantees of such models have not been thoroughly investigated. In this paper, we present a novel stability analysis method and provide sufficient conditions of DMM’s stochastic stability. The proposed stability analysis is based on the contraction of probabilistic maps modeled by deep neural networks. We make connections between the spectral properties of neural network’s weights and different types of used activation function on the stability and overall dynamic behavior of DMMs with Gaussian distributions. Based on the theory, we propose a few practical methods for designing constrained DMMs with guaranteed stability. We empirically substantiate our theoretical results via intuitive numerical experiments using the proposed stability constraints.

5. UQ

   Probabilistic modeling and prediction of out-of-plane unidirectional composite lamina properties

   Jiaxin Zhang, Michael Shields, and Stephanie TerMaath

   Mechanics of Advanced Materials and Structures, 2021
6. AI4Science

   Transfer learning based variable-fidelity surrogate model for shell buckling prediction

   Kuo Tian, Zengcong Li, Jiaxin Zhang, Lei Huang, and Bo Wang

   Composite Structures, 2021
7. ICLR Workshop

   Variational Generative Flows for Reconstruction Uncertainty Estimation

   Jiaxin Zhang, Jan Drgona, Sayak Mukherjee, Mahantesh Halappanavar, and Frank Liu

   In ICML 2021 Workshop on Uncertainty and Robustness in Deep Learning, 2021
8. ERA

   Accelerating reinforcement learning with a Directional-Gaussian-Smoothing evolution strategy

   Zhang Jiaxin, Tran Hoang, and Zhang Guannan

   Electronic Research Archive, 2021
9. AI4Science

   Benchmarking graph neural networks for materials chemistry

   Victor Fung, Jiaxin Zhang, Eric Juarez, and Bobby G Sumpter

   npj Computational Materials, 2021
10. UAI

    Enabling Long-range Exploration in Minimization of Multimodal Functions

    Jiaxin Zhang, Hoang Tran, Dan Lu, and Guannan Zhang

    In Uncertainty in Artificial Intelligence, 2021

    Abs arXiv PDF Code

    We consider the problem of minimizing multi-modal loss functions with a large number of local optima. Since the local gradient points to the direction of the steepest slope in an infinitesimal neighborhood, an optimizer guided by the local gradient is often trapped in a local minimum. To address this issue, we develop a novel nonlocal gradient to skip small local minima by capturing major structures of the loss’s landscape in black-box optimization. The nonlocal gradient is defined by a directional Gaussian smoothing (DGS) approach. The key idea of DGS is to conducts 1D long-range exploration with a large smoothing radius along orthogonal directions in , each of which defines a nonlocal directional derivative as a 1D integral. Such long-range exploration enables the nonlocal gradient to skip small local minima. The directional derivatives are then assembled to form the nonlocal gradient. We use the Gauss-Hermite quadrature rule to approximate the 1D integrals to obtain an accurate estimator. The superior performance of our method is demonstrated in three sets of examples, including benchmark functions for global optimization, and two real-world scientific problems.

11. AISTATS

    A Scalable Gradient Free Method for Bayesian Experimental Design with Implicit Models

    Jiaxin Zhang, Sirui Bi, and Guannan Zhang

    In International Conference on Artificial Intelligence and Statistics, 2021

    Abs PDF

    Bayesian experimental design (BED) is to answer the question that how to choose designs that maximize the information gathering. For implicit models, where the likelihood is intractable but sampling is possible, conventional BED methods have difficulties in efficiently estimating the posterior distribution and maximizing the mutual information (MI) between data and parameters. Recent work proposed the use of gradient ascent to maximize a lower bound on MI to deal with these issues. However, the approach requires a sampling path to compute the pathwise gradient of the MI lower bound with respect to the design variables, and such a pathwise gradient is usually inaccessible for implicit models. In this paper, we propose a novel approach that leverages recent advances in stochastic approximate gradient ascent incorporated with a smoothed variational MI estimator for efficient and robust BED. Without the necessity of pathwise gradients, our approach allows the design process to be achieved through a unified procedure with an approximate gradient for implicit models. Several experiments show that our approach outperforms baseline methods, and significantly improves the scalability of BED in high-dimensional problems

12. ICLR Workshop

    Efficient inverse learning for materials design and discovery

    Jiaxin Zhang, and Victor Fung

    In ICLR 2021 Workshop on Science and Engineering of Deep Learning, 2021
13. ICLR Workshop

    Towards Efficient Uncertainty estimation in deep learning for robust energy prediction in crystal materials

    Sirui Bi, Victor Fung, Jiaxin Zhang, and Guannan Zhang

    In ICLR 2021 Workshop on Deep Learning for Simulation, 2021
14. AI4Science

    Monte Carlo simulation of order-disorder transition in refractory high entropy alloys: A data-driven approach

    Xianglin Liu, Jiaxin Zhang, Junqi Yin, Sirui Bi, Markus Eisenbach, and Yang Wang

    Computational Materials Science, 2021
15. MSSP

    Imprecise global sensitivity analysis using bayesian multimodel inference and importance sampling

    Jiaxin Zhang, Stephanie TerMaath, and Michael D Shields

    Mechanical Systems and Signal Processing, 2021
16. AI4Science

    A directional Gaussian smoothing optimization method for computational inverse design in nanophotonics

    Jiaxin Zhang, Sirui Bi, and Guannan Zhang

    Materials & Design, 2021
17. WIREs

    Modern Monte Carlo methods for efficient uncertainty quantification and propagation: A survey

    Jiaxin Zhang

    Wiley Interdisciplinary Reviews: Computational Statistics, 2021

2020

1. NeurIPS Workshop

   Scalable deep-learning-accelerated topology optimization for additively manufactured materials

   Sirui Bi, Jiaxin Zhang, and Guannan Zhang

   In NeurIPS 2020 Workshop on Machine Learning for Engineering Modeling, Simulation, and Design, 2020

   PDF
2. JPCM

   Fast and stable deep-learning predictions of material properties for solid solution alloys

   Massimiliano Lupo Pasini, Ying Wai Li, Junqi Yin, Jiaxin Zhang, Kipton Barros, and Markus Eisenbach

   Journal of Physics: Condensed Matter, 2020
3. IJAR

   On the quantification and efficient propagation of imprecise probabilities with copula dependence

   Jiaxin Zhang, and Michael Shields

   International Journal of Approximate Reasoning, 2020
4. SMO

   Toward the robust establishment of variable-fidelity surrogate models for hierarchical stiffened shells by two-step adaptive updating approach

   Kuo Tian, Zengcong Li, Xiangtao Ma, Haixin Zhao, Jiaxin Zhang, and Bo Wang

   Structural and Multidisciplinary Optimization, 2020
5. AI4Science

   Robust data-driven approach for predicting the configurational energy of high entropy alloys

   Jiaxin Zhang, Xianglin Liu, Sirui Bi, Junqi Yin, Guannan Zhang, and Markus Eisenbach

   Materials & Design, 2020

2019

1. JRPC

   Buckling surrogate-based optimization framework for hierarchical stiffened composite shells by enhanced variance reduction method

   Kuo Tian, Jiaxin Zhang, Xiangtao Ma, Yuwei Li, Yu Sun, and Peng Hao

   Journal of Reinforced Plastics and Composites, 2019
2. NeurIPS

   Learning Nonlinear Level Sets for Dimensionality Reduction in Function Approximation

   Guannan Zhang, Jiaxin Zhang, and Jacob Hinkle

   Advances in Neural Information Processing Systems, 2019

   Abs arXiv PDF Code

   We developed a Nonlinear Level-set Learning (NLL) method for dimensionality reduction in high-dimensional function approximation with small data. This work is motivated by a variety of design tasks in real-world engineering applications, where practitioners would replace their computationally intensive physical models (e.g., high-resolution fluid simulators) with fast-to-evaluate predictive machine learning models, so as to accelerate the engineering design processes. There are two major challenges in constructing such predictive models: (a) high-dimensional inputs (e.g., many independent design parameters) and (b) small training data, generated by running extremely time-consuming simulations. Thus, reducing the input dimension is critical to alleviate the over-fitting issue caused by data insufficiency. Existing methods, including sliced inverse regression and active subspace approaches, reduce the input dimension by learning a linear coordinate transformation; our main contribution is to extend the transformation approach to a nonlinear regime. Specifically, we exploit reversible networks (RevNets) to learn nonlinear level sets of a high-dimensional function and parameterize its level sets in low-dimensional spaces. A new loss function was designed to utilize samples of the target functions’ gradient to encourage the transformed function to be sensitive to only a few transformed coordinates. The NLL approach is demonstrated by applying it to three 2D functions and two 20D functions for showing the improved approximation accuracy with the use of nonlinear transformation, as well as to an 8D composite material design problem for optimizing the buckling-resistance performance of composite shells of rocket inter-stages.

3. AI4Science

   Chemical complexity in high entropy alloys: a pair-interaction perspective

   Xianglin Liu, Jiaxin Zhang, Sirui Bi, Yang Wang, G Malcolm Stocks, and Markus Eisenbach

   arXiv preprint arXiv:1907.10223, 2019
4. AI4Science

   Machine learning modeling of high entropy alloy: the role of short-range order

   Xianglin Liu, Jiaxin Zhang, Markus Eisenbach, and Yang Wang

   arXiv preprint arXiv:1906.02889, 2019
5. PEM

   Efficient Monte Carlo resampling for probability measure changes from Bayesian updating

   Jiaxin Zhang, and Michael D Shields

   Probabilistic Engineering Mechanics, 2019

2018

1. TWS

   Tailoring the optimal load-carrying efficiency of hierarchical stiffened shells by competitive sampling

   Kuo Tian, Bo Wang, Ke Zhang, Jiaxin Zhang, Peng Hao, and Ying Wu

   Thin-Walled Structures, 2018
2. CMAME

   The effect of prior probabilities on quantification and propagation of imprecise probabilities resulting from small datasets

   Jiaxin Zhang, and Michael D Shields

   Computer Methods in Applied Mechanics and Engineering, 2018
3. MSSP

   On the quantification and efficient propagation of imprecise probabilities resulting from small datasets

   Jiaxin Zhang, and Michael D Shields

   Mechanical Systems and Signal Processing, 2018

2017

2016

1. RESS

   The Generalization of Latin Hypercube Sampling

   Michael D Shields, and Jiaxin Zhang

   Reliability Engineering & System Safety, 2016

   Abs arXiv PDF Code

   Latin hypercube sampling (LHS) is generalized in terms of a spectrum of stratified sampling (SS) designs referred to as partially stratified sample (PSS) designs. True SS and LHS are shown to represent the extremes of the PSS spectrum. The variance of PSS estimates is derived along with some asymptotic properties. PSS designs are shown to reduce variance associated with variable interactions, whereas LHS reduces variance associated with main effects. Challenges associated with the use of PSS designs and their limitations are discussed. To overcome these challenges, the PSS method is coupled with a new method called Latinized stratified sampling (LSS) that produces sample sets that are simultaneously SS and LHS. The LSS method is equivalent to an Orthogonal Array based LHS under certain conditions but is easier to obtain. Utilizing an LSS on the subspaces of a PSS provides a sampling strategy that reduces variance associated with both main effects and variable interactions and can be designed specially to minimize variance for a given problem. Several high-dimensional numerical examples highlight the strengths and limitations of the method. The Latinized partially stratified sampling method is then applied to identify the best sample strategy for uncertainty quantification on a plate buckling problem.

2015

1. MBDSM

   Design optimization of connection section for concentrated force diffusion

   Jiaxin Zhang, Bo Wang, Fei Niu, and Gengdong Cheng

   Mechanics Based Design of Structures and Machines, 2015

2014

1. AMS

   Optimum design of hierarchical stiffened shells for low imperfection sensitivity

   Bo Wang, Peng Hao, Gang Li, Jia-Xin Zhang, Kai-Fan Du, Kuo Tian, Xiao-Jun Wang, and Xiao-Han Tang

   Acta Mechanica Sinica, 2014