Over the years, mathematical statistics have become increasingly important in the social sciences. In fact, the use of mathematical statistics methods is now ubiquitous: Almost all social sciences rely on statistical methods to analyze data and to form hypotheses, and almost all of them use more or less a range of mathematical methods to help us understand the social world to some extent. Focusing on this the paper analyse and surveyed a variety of mathematical methods that are used in the social sciences and argued that such techniques, in spite of several methodological objections, can add extra value to social scientific research. It also discus some of their philosophical questions and focused on methodological issues in statistics- the part of mathematics that is most frequently used in the social sciences, in particular in the design and interpretation of experiments. The paper also analyzes the emergence of the rationale behind the ubiquitous significance tests, as well as explained the pitfalls to which many researches fall prey when using them. Finally, after comparing significance testing to rivalling schools of statistical inference, the recent trends was discussed in the methodology of the social sciences.