For many people, Calculus is the most difficult math subject. But it really depends on what is easier for you. For example, some people who are excellent at Calculus still have trouble with basic algebra. Calculus has long been considered the most difficult math subject. For younger kids algerbra is also very difficult to learn.