Despite the small amount in the asphalt concrete, the binder plays an important role in load bearing and other behavior of asphalt pavements. As a result, binder modification is an important contribution to a higher-quality asphalt concrete. A lot of desired characteristics can be found in the asphalt binders, although these binders contain some issues. One of these issues that affects the durability of pavement overlays is aging which refers to changing in the physiochemical properties of the asphalt. These changes make the asphalt brittle and result in the early occurrence of fatigue and thermal cracking and raveling. Finally the pavement serviceability would be reduced. Recently, many types of modifiers such as polymers, chemicals, fibers and fillers have been utilized to improve the performance of the asphalt concrete. The polymeric ones are of a special interest due to their improvement in each range of temperature. The binder in asphalt concrete comprises both bitumen and filler, so the filler may influence the aging parameters and deterioration of asphalt concrete. Additionally production, construction and service life conditions play an important role in aging. To consider the affecting parameters, this research evaluated three polymeric modifiers (SBR, EVA and CR) and two fillers (Hydrated Lime and Carbon Black) in aging characteristics of bitumen by implementing Performance Grading and mid-temperature fatigue tests. The samples were in 3 different aging conditions: RTFO aged (to simulate the aging in production process), PAV aged (to simulate the aging of emulsified asphalt in service life) and RTFO+PAV aged (to simulate the asphalt cement in service life). The results indicate that polymer-modified binders showed a better performance characteristics after aging, so did the hydrated lime. Thereupon a combination of polymer and filler modifiers are useful to improve the performance of the aged binder. Keywords : Aging, Styrene Butadiene Rubber (SBR), Ethylene Vinyl Acetate (EVA), Crumb Rubber (CR), Filler, Hydrated Lime (HL), Carbon Black (CB), Time Sweep Test.