From a materials science and engineering stand-point, materials which exhibit work-hardening change their structure at lattice and microstructural scales as plastic deformation proceeds in such a way as to resist further deformation. Virtually all metals exhibit work hardening, and thermoplastic polymers may also exhibit work-hardening (or work-softening) depending on temperature, strain-rate, and polymer chain structure and organization.
Metals
For metals, the general theory holds that plastic deformation occurs due to the motion of crystal lattice dislocations through the material. Dislocations and other lattice defects put the surrounding lattice into various states of stress. As a dislocation moves through the lattice, it may come near another defect, and the stress fields surrounding them will interact. If the stress fields increase as a result of moving the two defects closer together, it takes increasing effort to move the dislocation. In other words, the local lattice yield stress increases with increasing strain.
For constant environmental conditions, the non-dislocation defects have constant concentration, and this only explains the existence of a yield point. However, a number of proposed, and generally accepted, mechanisms exist for building up the concentration of dislocations within the metal as plastic deformation proceeds. The mechanisms include dislocation pileups on inclusions and grain boundaries, and dislocation sources pumping new dislocations into grains with increasing strain. These mechanisms increase the concentration of dislocations in metal grains, making further strain increasingly difficult. The result at large scales is work-hardening: as strain increases, stress needed to cause continued flow increases. Additionally, strain-to-failure decreases.
Metals which undergo work-hardening have increased yield strengths, but only at low homologous temperatures. Homologous temperature is current absolute temperature divided by absolute melting temperature. An increase in work-hardening is associated with an increased level of energy storage in the material, which means an increase in free energy. Work-hardening, therefore, is unstable. Given enough time, or increased temperatures, dislocations will move in such a way as to reduce strain energy, which will reduce the yield strength toward the original, un-strained material strength. Exceedingly pure metals, and metals at sufficiently high homologous temperatures, can recover their yield strength as rapidly as they are deformed. As a result, there are a continuum of heat treatments available to control the properties of metals.
It is worth noting that work-hardening effects are partly anisotropic. I am unsure of the precise microstructural explanations for this, but I imagine it has to do with grains changing shape, different dislocation concentrations along different axes, and dislocation pileup occuring anisotropically. Uniaxial strain will harden a metal to a greater degree in the direction of strain, such as in wire drawing. Biaxial strain will usually harden a metal to a greater degree in the plane of forming than in the thickness direction, as with sheet-forming. It is worth noting that if the strain is tensile, the compressive yield strength of the material in that direction will decrease as the tensile yield strength increases, due to the Bauschinger effect.
The above applies to face-centered cubic and body-centered cubic metals generally. Hexagonal close-packed metals do exhibit work-hardening, but tend to be more brittle, so be careful modeling HCP metals. You may find this article useful in understanding everything going on.
Polymers
Thermoplastic polymers I know less about, but my understanding is that at a microstructural level the chains are randomly oriented and tangled in amorphous polymers, and in crystalline polymers the chains are laterally organized in crystalline spherulites interspersed by amorphous regions. If the polymer is strained slowly enough, or at high enough temperature, the chains have time to reorganize as they are strained. Generally, the chains will tend to organize in order to maximize the stress on each individual chain, so that the chains align length-wise along the direction of stress. As the fraction of chains aligned with the stress direction increases, the strength of the polymer increases. This process, referred to as polymer chain orientation, is exploited during blow molding of PET soft drink bottles to increase the local in-plane mechanical properties of the bottles. There is also an added benefit of decreasing carbon dioxide permeability in the thickness direction because there is less room between individual chains for gas to pass through. Less free volume in polymers is associated with less ductility and a tendency toward brittle fracture, among other things.
Work-hardening in both thermoplastics and metals increases strength in the direction of stress and decreases further ductility, but there are a number of differences between them. First, the change in strength for thermoplastics is entirely anisotropic, and polymers weaken in directions other than the stress directions, whether uniaxial or biaxial. For metals, due to the different microstructural mechanisms, there is some increase in yield strength in non-stress directions. Second, dislocation density may be reduced via heat treatments without melting the metal, but to remove full polymer orientation virtually requires melting the polymer. Third, the exact chain structure -- i.e. length, side-groups, branching, tacticity, copolymerization -- of a given thermoplastic plays a role in how orientable the chains are, as well as virtually all of its other properties. With metals grain size, concentration of inclusions, and previous working history are the major factors in work hardenability.